Nov 15 18:32:13 user nova-compute[75634]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75634) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75634) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75634) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 18:32:13 user nova-compute[75634]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:32:13 user nova-compute[75634]: INFO nova.virt.driver [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 18:32:13 user nova-compute[75634]: INFO nova.compute.provider_config [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Acquiring lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Acquired lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Releasing lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Full set of CONF: {{(pid=75634) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ******************************************************************************** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Configuration options gathered from: {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ================================================================================ {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] allow_resize_to_same_host      = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] arq_binding_timeout            = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] backdoor_port                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] backdoor_socket                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] block_device_allocate_retries  = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] block_device_allocate_retries_interval = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cert                           = self.pem {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute_monitors               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] config_dir                     = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] config_drive_format            = iso9660 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] config_source                  = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] console_host                   = user {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] control_exchange               = nova {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cpu_allocation_ratio           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] daemon                         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] debug                          = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_access_ip_network_name = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_availability_zone      = nova {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_ephemeral_format       = ext4 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_green_pool_size        = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] default_schedule_zone          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] disk_allocation_ratio          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] enable_new_services            = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] enabled_ssl_apis               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] flat_injected                  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] force_config_drive             = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] force_raw_images               = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] graceful_shutdown_timeout      = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] heal_instance_info_cache_interval = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] host                           = user {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_build_timeout         = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_delete_interval       = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_name_template         = instance-%08x {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_usage_audit           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_usage_audit_period    = month {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] internal_service_availability_zone = internal {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] key                            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] live_migration_retry_count     = 30 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_config_append              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_dir                        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_file                       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_options                    = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_rotate_interval            = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_rotate_interval_type       = days {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] log_rotation_type              = none {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] long_rpc_timeout               = 1800 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_concurrent_builds          = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_concurrent_live_migrations = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_concurrent_snapshots       = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_local_block_devices        = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_logfile_count              = 30 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] max_logfile_size_mb            = 200 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] maximum_instance_delete_attempts = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metadata_listen                = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metadata_listen_port           = 8775 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metadata_workers               = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] migrate_max_retries            = -1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] mkisofs_cmd                    = genisoimage {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] my_ip                          = 10.0.0.210 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] network_allocate_retries       = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] osapi_compute_listen_port      = 8774 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] osapi_compute_unique_server_name_scope =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] osapi_compute_workers          = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] password_length                = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] periodic_enable                = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] periodic_fuzzy_delay           = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] pointer_model                  = ps2mouse {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] preallocate_images             = none {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] publish_errors                 = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] pybasedir                      = /opt/stack/nova {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ram_allocation_ratio           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rate_limit_burst               = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rate_limit_except_level        = CRITICAL {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rate_limit_interval            = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reboot_timeout                 = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reclaim_instance_interval      = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] record                         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reimage_timeout_per_gb         = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] report_interval                = 120 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rescue_timeout                 = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reserved_host_cpus             = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reserved_host_disk_mb          = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reserved_host_memory_mb        = 512 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] reserved_huge_pages            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] resize_confirm_window          = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] resize_fs_using_block_device   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] resume_guests_state_on_host_boot = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rpc_response_timeout           = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] run_external_periodic_tasks    = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] running_deleted_instance_action = reap {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] running_deleted_instance_timeout = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler_instance_sync_interval = 120 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_down_time              = 720 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] servicegroup_driver            = db {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] shelved_offload_time           = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] shelved_poll_interval          = 3600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] shutdown_timeout               = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] source_is_ipv6                 = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ssl_only                       = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] state_path                     = /opt/stack/data/nova {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] sync_power_state_interval      = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] sync_power_state_pool_size     = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] syslog_log_facility            = LOG_USER {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] tempdir                        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] timeout_nbd                    = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] transport_url                  = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] update_resources_interval      = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_cow_images                 = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_eventlog                   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_journal                    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_json                       = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_rootwrap_daemon            = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_stderr                     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] use_syslog                     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vcpu_pin_set                   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plugging_is_fatal          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plugging_timeout           = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] virt_mkfs                      = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] volume_usage_poll_interval     = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] watch_log_file                 = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] web                            = /usr/share/spice-html5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.auth_strategy              = keystone {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.compute_link_prefix        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.dhcp_domain                = novalocal {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.enable_instance_password   = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.glance_link_prefix         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.instance_list_per_project_cells = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.list_records_by_skipping_down_cells = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.local_metadata_per_cell    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.max_limit                  = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.metadata_cache_expiration  = 15 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.neutron_default_tenant_id  = default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.use_forwarded_for          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.use_neutron_default_nets   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_dynamic_targets = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_jsonfile_path   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.backend_argument         = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.config_prefix            = cache.oslo {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.dead_timeout             = 60.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.debug_cache_backend      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.enable_retry_client      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.enable_socket_keepalive  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.enabled                  = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.expiration_time          = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_dead_retry      = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_password        =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_sasl_enabled    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.memcache_username        =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.proxies                  = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.retry_attempts           = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.retry_delay              = 0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.socket_keepalive_count   = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.socket_keepalive_idle    = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.socket_keepalive_interval = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.tls_allowed_ciphers      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.tls_cafile               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.tls_certfile             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.tls_enabled              = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cache.tls_keyfile              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.auth_section            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.auth_type               = password {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.cafile                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.certfile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.collect_timing          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.cross_az_attach         = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.debug                   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.endpoint_template       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.http_retries            = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.insecure                = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.keyfile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.os_region_name          = RegionOne {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.split_loggers           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cinder.timeout                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.cpu_dedicated_set      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.cpu_shared_set         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.image_type_exclude_list = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.resource_provider_association_refresh = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.shutdown_retry_interval = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] conductor.workers              = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] console.allowed_origins        = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] console.ssl_ciphers            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] console.ssl_minimum_version    = default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] consoleauth.token_ttl          = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.cafile                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.certfile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.collect_timing          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.connect_retries         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.connect_retry_delay     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.endpoint_override       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.insecure                = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.keyfile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.max_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.min_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.region_name             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.service_name            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.service_type            = accelerator {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.split_loggers           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.status_code_retries     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.timeout                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] cyborg.version                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.backend               = sqlalchemy {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.connection            = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.connection_debug      = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.connection_parameters =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.connection_recycle_time = 3600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.connection_trace      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.db_inc_retry_interval = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.db_max_retries        = 20 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.db_max_retry_interval = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.db_retry_interval     = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.max_overflow          = 50 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.max_pool_size         = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.max_retries           = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.pool_timeout          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.retry_interval        = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.slave_connection      = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] database.sqlite_synchronous    = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.backend           = sqlalchemy {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.connection        = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.connection_debug  = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.connection_parameters =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.connection_recycle_time = 3600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.connection_trace  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.db_inc_retry_interval = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.db_max_retries    = 20 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.db_max_retry_interval = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.db_retry_interval = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.max_overflow      = 50 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.max_pool_size     = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.max_retries       = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.pool_timeout      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.retry_interval    = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.slave_connection  = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] api_database.sqlite_synchronous = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] devices.enabled_mdev_types     = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ephemeral_storage_encryption.enabled = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.api_servers             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.cafile                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.certfile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.collect_timing          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.connect_retries         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.connect_retry_delay     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.debug                   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.default_trusted_certificate_ids = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.enable_certificate_validation = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.enable_rbd_download     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.endpoint_override       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.insecure                = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.keyfile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.max_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.min_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.num_retries             = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.rbd_ceph_conf           =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.rbd_connect_timeout     = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.rbd_pool                =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.rbd_user                =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.region_name             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.service_name            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.service_type            = image {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.split_loggers           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.status_code_retries     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.timeout                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.verify_glance_signatures = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] glance.version                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] guestfs.debug                  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.config_drive_cdrom      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.config_drive_inject_password = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.enable_remotefx         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.instances_path_share    =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.limit_cpu_features      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.use_multipath_io        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.vswitch_name            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] mks.enabled                    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.manager_interval   = 2400 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.precache_concurrency = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.remove_unused_base_images = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] image_cache.subdirectory_name  = _base {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.api_max_retries         = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.api_retry_interval      = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.auth_section            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.auth_type               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.cafile                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.certfile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.collect_timing          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.conductor_group         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.connect_retries         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.connect_retry_delay     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.endpoint_override       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.insecure                = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.keyfile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.max_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.min_version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.peer_list               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.region_name             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.serial_console_state_timeout = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.service_name            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.service_type            = baremetal {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.split_loggers           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.status_code_retries     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.timeout                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ironic.version                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] key_manager.fixed_key          = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.barbican_api_version  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.barbican_endpoint     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.barbican_endpoint_type = public {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.barbican_region_name  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.cafile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.certfile              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.collect_timing        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.insecure              = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.keyfile               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.number_of_retries     = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.retry_delay           = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.send_service_user_token = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.split_loggers         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.timeout               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.verify_ssl            = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican.verify_ssl_path       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.auth_section = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.auth_type = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.cafile   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.certfile = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.collect_timing = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.insecure = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.keyfile  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.split_loggers = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] barbican_service_user.timeout  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.approle_role_id          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.approle_secret_id        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.cafile                   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.certfile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.collect_timing           = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.insecure                 = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.keyfile                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.kv_mountpoint            = secret {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.kv_path                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.kv_version               = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.namespace                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.root_token_id            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.split_loggers            = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.ssl_ca_crt_file          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.timeout                  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.use_ssl                  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.auth_section          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.auth_type             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.cafile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.certfile              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.collect_timing        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.connect_retries       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.connect_retry_delay   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.endpoint_override     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.insecure              = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.keyfile               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.max_version           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.min_version           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.region_name           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.service_name          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.service_type          = identity {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.split_loggers         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.status_code_retries   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.timeout               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] keystone.version               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.connection_uri         =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_mode               = custom {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: WARNING oslo_config.cfg [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_power_governor_high = performance {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_power_management   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.device_detach_attempts = 8 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.device_detach_timeout  = 20 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.disk_cachemodes        = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.disk_prefix            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.enabled_perf_events    = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.file_backed_memory     = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.gid_maps               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.hw_disk_discard        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.hw_machine_type        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_rbd_pool        = rbd {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_type            = default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.images_volume_group    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.inject_key             = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.inject_partition       = -2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.inject_password        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.iscsi_iface            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.iser_use_multipath     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_downtime = 500 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_inbound_addr = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_scheme  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_timeout_action = abort {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_tunnelled = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: WARNING oslo_config.cfg [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 18:32:13 user nova-compute[75634]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 18:32:13 user nova-compute[75634]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 18:32:13 user nova-compute[75634]: and ``live_migration_inbound_addr`` respectively.
Nov 15 18:32:13 user nova-compute[75634]: ).  Its value may be silently ignored in the future.
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.live_migration_with_native_tls = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.max_queues             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.nfs_mount_options      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_pcie_ports         = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.pmem_namespaces        = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.quobyte_client_cfg     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rbd_secret_uuid        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rbd_user               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rescue_image_id        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rescue_kernel_id       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.rx_queue_size          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.smbfs_mount_options    =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.snapshot_compression   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.snapshot_image_format  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.sparse_logical_volumes = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.swtpm_enabled          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.swtpm_group            = tss {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.swtpm_user             = tss {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.sysinfo_serial         = unique {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.tb_cache_size          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.tx_queue_size          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.uid_maps               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.use_virtio_for_bridges = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.virt_type              = kvm {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.volume_clear           = zero {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.volume_clear_size      = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.volume_use_multipath   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_cache_path   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.auth_section           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.auth_type              = password {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.cafile                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.certfile               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.collect_timing         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.connect_retries        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.connect_retry_delay    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.default_floating_pool  = public {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.endpoint_override      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.extension_sync_interval = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.http_retries           = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.insecure               = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.keyfile                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.max_version            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.min_version            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.ovs_bridge             = br-int {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.physnets               = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.region_name            = RegionOne {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.service_metadata_proxy = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.service_name           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.service_type           = network {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.split_loggers          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.status_code_retries    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.timeout                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] neutron.version                = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] notifications.bdms_in_notifications = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] notifications.default_level    = INFO {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] notifications.notification_format = unversioned {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] notifications.notify_on_state_change = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] pci.alias                      = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] pci.device_spec                = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] pci.report_in_placement        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.auth_section         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.auth_type            = password {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.cafile               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.certfile             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.collect_timing       = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.connect_retries      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.connect_retry_delay  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.default_domain_id    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.default_domain_name  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.domain_id            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.domain_name          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.endpoint_override    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.insecure             = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.keyfile              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.max_version          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.min_version          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.password             = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.project_domain_id    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.project_domain_name  = Default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.project_id           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.project_name         = service {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.region_name          = RegionOne {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.service_name         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.service_type         = placement {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.split_loggers        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.status_code_retries  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.system_scope         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.timeout              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.trust_id             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.user_domain_id       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.user_domain_name     = Default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.user_id              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.username             = placement {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] placement.version              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.cores                    = 20 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.count_usage_from_placement = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.injected_file_content_bytes = 10240 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.injected_file_path_length = 255 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.injected_files           = 5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.instances                = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.key_pairs                = 100 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.metadata_items           = 128 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.ram                      = 51200 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.recheck_quota            = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.server_group_members     = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] quota.server_groups            = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rdp.enabled                    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.image_metadata_prefilter = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.max_attempts         = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.max_placement_results = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] scheduler.workers              = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.host_subset_size = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.isolated_hosts = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.isolated_images = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.pci_in_placement = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.track_instance_changes = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metrics.required               = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metrics.weight_multiplier      = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] metrics.weight_setting         = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.enabled         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.port_range      = 10000:20000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] serial_console.serialproxy_port = 6083 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.auth_section      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.auth_type         = password {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.cafile            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.certfile          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.collect_timing    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.insecure          = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.keyfile           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.send_service_user_token = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.split_loggers     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] service_user.timeout           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.agent_enabled            = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.enabled                  = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.html5proxy_port          = 6082 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.image_compression        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.jpeg_compression         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.playback_compression     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.server_listen            = 127.0.0.1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.streaming_mode           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] spice.zlib_compression         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] upgrade_levels.baseapi         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] upgrade_levels.cert            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] upgrade_levels.compute         = auto {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] upgrade_levels.conductor       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] upgrade_levels.scheduler       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.cafile = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.certfile = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.insecure = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vendordata_dynamic_auth.timeout = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.api_retry_count         = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.ca_file                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.cache_prefix            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.cluster_name            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.connection_pool_size    = 10 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.console_delay_seconds   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.datastore_regex         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.host_ip                 = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.host_password           = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.host_port               = 443 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.host_username           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.insecure                = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.integration_bridge      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.maximum_objects         = 100 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.pbm_default_policy      = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.pbm_enabled             = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.pbm_wsdl_location       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.serial_port_proxy_uri   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.serial_port_service_uri = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.task_poll_interval      = 0.5 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.use_linked_clone        = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.vnc_keymap              = en-us {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.vnc_port                = 5900 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vmware.vnc_port_total          = 10000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.auth_schemes               = ['none'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.enabled                    = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.novncproxy_port            = 6080 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.vencrypt_ca_certs          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.vencrypt_client_cert       = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vnc.vencrypt_client_key        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.disable_rootwrap   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.enable_numa_live_migration = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.libvirt_disable_apic = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.client_socket_timeout     = 900 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.default_pool_size         = 1000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.keep_alive                = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.max_header_line           = 16384 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.ssl_ca_file               = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.ssl_cert_file             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.ssl_key_file              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.tcp_keepidle              = 600 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] zvm.ca_file                    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] zvm.cloud_connector_url        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] zvm.reachable_timeout          = 300 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.enforce_scope      = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.policy_default_rule = default {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.connection_string     = messaging:// {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.enabled               = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.es_doc_type           = notification {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.es_scroll_size        = 10000 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.es_scroll_time        = 2m {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.filter_error_trace    = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.hmac_keys             = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.sentinel_service_name = mymaster {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.socket_timeout        = 0.1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.trace_requests        = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler.trace_sqlalchemy      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler_jaeger.process_tags   = {} {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] profiler_otlp.service_name_prefix = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] remote_debug.host              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] remote_debug.port              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.auth_section        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.auth_type           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.cafile              = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.certfile            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.collect_timing      = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.connect_retries     = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.connect_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.endpoint_id         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.endpoint_override   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.insecure            = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.keyfile             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.max_version         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.min_version         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.region_name         = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.service_name        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.service_type        = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.split_loggers       = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.status_code_retries = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.status_code_retry_delay = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.timeout             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.valid_interfaces    = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_limit.version             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_reports.file_event_handler = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] oslo_reports.log_dir           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.group  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] vif_plug_ovs_privileged.user   = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.isolate_vif         = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] os_brick.lock_path             = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.capabilities   = [21] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.group          = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.helper_command = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] privsep_osbrick.user           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.group           = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.helper_command  = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] nova_sys_admin.user            = None {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG oslo_service.service [None req-36086bf7-3418-411a-9335-6dfbed10f2b4 None None] ******************************************************************************** {{(pid=75634) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 18:32:13 user nova-compute[75634]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Connecting to libvirt: qemu:///system {{(pid=75634) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5b711caec0> {{(pid=75634) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 18:32:13 user nova-compute[75634]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 18:32:13 user nova-compute[75634]: WARNING nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5b711caec0> {{(pid=75634) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Starting native event thread {{(pid=75634) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Starting green dispatch thread {{(pid=75634) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Starting connection event dispatch thread {{(pid=75634) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 18:32:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Connection event '1' reason 'None'
Nov 15 18:32:13 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 18:32:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.mount [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Initialising _HostMountState generation 0 {{(pid=75634) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host capabilities <capabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <host>
Nov 15 18:32:21 user nova-compute[75634]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 18:32:21 user nova-compute[75634]:     <cpu>
Nov 15 18:32:21 user nova-compute[75634]:       <arch>x86_64</arch>
Nov 15 18:32:21 user nova-compute[75634]:       <model>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <microcode version='1070'/>
Nov 15 18:32:21 user nova-compute[75634]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='osxsave'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='invtsc'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='rsba'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 18:32:21 user nova-compute[75634]:       <pages unit='KiB' size='4'/>
Nov 15 18:32:21 user nova-compute[75634]:       <pages unit='KiB' size='2048'/>
Nov 15 18:32:21 user nova-compute[75634]:     </cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <power_management>
Nov 15 18:32:21 user nova-compute[75634]:       <suspend_mem/>
Nov 15 18:32:21 user nova-compute[75634]:       <suspend_disk/>
Nov 15 18:32:21 user nova-compute[75634]:       <suspend_hybrid/>
Nov 15 18:32:21 user nova-compute[75634]:     </power_management>
Nov 15 18:32:21 user nova-compute[75634]:     <iommu support='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <migration_features>
Nov 15 18:32:21 user nova-compute[75634]:       <live/>
Nov 15 18:32:21 user nova-compute[75634]:       <uri_transports>
Nov 15 18:32:21 user nova-compute[75634]:         <uri_transport>tcp</uri_transport>
Nov 15 18:32:21 user nova-compute[75634]:         <uri_transport>rdma</uri_transport>
Nov 15 18:32:21 user nova-compute[75634]:       </uri_transports>
Nov 15 18:32:21 user nova-compute[75634]:     </migration_features>
Nov 15 18:32:21 user nova-compute[75634]:     <topology>
Nov 15 18:32:21 user nova-compute[75634]:       <cells num='2'>
Nov 15 18:32:21 user nova-compute[75634]:         <cell id='0'>
Nov 15 18:32:21 user nova-compute[75634]:           <memory unit='KiB'>8189224</memory>
Nov 15 18:32:21 user nova-compute[75634]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 18:32:21 user nova-compute[75634]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 18:32:21 user nova-compute[75634]:           <distances>
Nov 15 18:32:21 user nova-compute[75634]:             <sibling id='0' value='10'/>
Nov 15 18:32:21 user nova-compute[75634]:             <sibling id='1' value='20'/>
Nov 15 18:32:21 user nova-compute[75634]:           </distances>
Nov 15 18:32:21 user nova-compute[75634]:           <cpus num='6'>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 18:32:21 user nova-compute[75634]:           </cpus>
Nov 15 18:32:21 user nova-compute[75634]:         </cell>
Nov 15 18:32:21 user nova-compute[75634]:         <cell id='1'>
Nov 15 18:32:21 user nova-compute[75634]:           <memory unit='KiB'>8206460</memory>
Nov 15 18:32:21 user nova-compute[75634]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 18:32:21 user nova-compute[75634]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 18:32:21 user nova-compute[75634]:           <distances>
Nov 15 18:32:21 user nova-compute[75634]:             <sibling id='0' value='20'/>
Nov 15 18:32:21 user nova-compute[75634]:             <sibling id='1' value='10'/>
Nov 15 18:32:21 user nova-compute[75634]:           </distances>
Nov 15 18:32:21 user nova-compute[75634]:           <cpus num='6'>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 18:32:21 user nova-compute[75634]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 18:32:21 user nova-compute[75634]:           </cpus>
Nov 15 18:32:21 user nova-compute[75634]:         </cell>
Nov 15 18:32:21 user nova-compute[75634]:       </cells>
Nov 15 18:32:21 user nova-compute[75634]:     </topology>
Nov 15 18:32:21 user nova-compute[75634]:     <cache>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 18:32:21 user nova-compute[75634]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 18:32:21 user nova-compute[75634]:     </cache>
Nov 15 18:32:21 user nova-compute[75634]:     <secmodel>
Nov 15 18:32:21 user nova-compute[75634]:       <model>apparmor</model>
Nov 15 18:32:21 user nova-compute[75634]:       <doi>0</doi>
Nov 15 18:32:21 user nova-compute[75634]:     </secmodel>
Nov 15 18:32:21 user nova-compute[75634]:     <secmodel>
Nov 15 18:32:21 user nova-compute[75634]:       <model>dac</model>
Nov 15 18:32:21 user nova-compute[75634]:       <doi>0</doi>
Nov 15 18:32:21 user nova-compute[75634]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 18:32:21 user nova-compute[75634]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 18:32:21 user nova-compute[75634]:     </secmodel>
Nov 15 18:32:21 user nova-compute[75634]:   </host>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='alpha'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>clipper</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='armv6l'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>spitz</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>nuri</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>kzm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>z2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>tosa</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n810</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>terrier</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>midway</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>microbit</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>verdex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>highbank</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>akita</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>connex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>collie</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='armv7l'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>spitz</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>nuri</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>kzm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>z2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>tosa</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n810</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>terrier</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>midway</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>microbit</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>verdex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>highbank</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>akita</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>connex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>collie</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='aarch64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>spitz</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>nuri</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>kzm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>z2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>tosa</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n810</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>n800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>terrier</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>midway</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>microbit</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>verdex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>highbank</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>akita</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>connex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>collie</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <acpi default='on' toggle='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='cris'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='i686'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>isapc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>microvm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='kvm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <pae/>
Nov 15 18:32:21 user nova-compute[75634]:       <nonpae/>
Nov 15 18:32:21 user nova-compute[75634]:       <acpi default='on' toggle='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:       <apic default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='m68k'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>an5206</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>q800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='microblaze'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='microblazeel'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='mips'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>malta</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='mipsel'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>malta</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='mips64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>malta</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>pica61</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>magnum</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='mips64el'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>malta</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>pica61</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>magnum</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='16'>boston</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='ppc'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mac99</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>40p</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>taihu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='ppc64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>taihu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>40p</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mac99</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='ppc64le'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>taihu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>40p</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>mac99</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='riscv32'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='8'>spike</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='8'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='riscv64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='8'>spike</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='8'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='s390x'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='sh4'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>shix</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>r2d</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='sh4eb'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>shix</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>r2d</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='sparc'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>LX</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='sparc64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>niagara</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='x86_64'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>64</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='1'>isapc</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>microvm</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='kvm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <acpi default='on' toggle='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:       <apic default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='xtensa'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>sim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>kc705</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ml605</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx200</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx60</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]:   <guest>
Nov 15 18:32:21 user nova-compute[75634]:     <os_type>hvm</os_type>
Nov 15 18:32:21 user nova-compute[75634]:     <arch name='xtensaeb'>
Nov 15 18:32:21 user nova-compute[75634]:       <wordsize>32</wordsize>
Nov 15 18:32:21 user nova-compute[75634]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='4'>sim</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>kc705</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ml605</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>virt</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx200</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>lx60</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 18:32:21 user nova-compute[75634]:       <domain type='qemu'/>
Nov 15 18:32:21 user nova-compute[75634]:     </arch>
Nov 15 18:32:21 user nova-compute[75634]:     <features>
Nov 15 18:32:21 user nova-compute[75634]:       <cpuselection/>
Nov 15 18:32:21 user nova-compute[75634]:       <deviceboot/>
Nov 15 18:32:21 user nova-compute[75634]:       <disksnapshot default='on' toggle='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     </features>
Nov 15 18:32:21 user nova-compute[75634]:   </guest>
Nov 15 18:32:21 user nova-compute[75634]: </capabilities>
Nov 15 18:32:21 user nova-compute[75634]: 
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-q35-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>i686</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='288'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'/>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='lm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-i440fx-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>i686</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='255'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'/>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='lm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ide</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-i440fx-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>i686</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='255'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'/>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='lm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ide</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-q35-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>i686</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='288'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'/>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='lm'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-q35-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>x86_64</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='288'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>efi</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='invtsc'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='rsba'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-i440fx-6.2</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>x86_64</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='255'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>efi</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='invtsc'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='rsba'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ide</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-i440fx-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>x86_64</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='255'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>efi</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='invtsc'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='rsba'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ide</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 18:32:21 user nova-compute[75634]: <domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 18:32:21 user nova-compute[75634]:   <domain>kvm</domain>
Nov 15 18:32:21 user nova-compute[75634]:   <machine>pc-q35-jammy</machine>
Nov 15 18:32:21 user nova-compute[75634]:   <arch>x86_64</arch>
Nov 15 18:32:21 user nova-compute[75634]:   <vcpu max='288'/>
Nov 15 18:32:21 user nova-compute[75634]:   <iothreads supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:   <os supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='firmware'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>efi</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:     <loader supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>rom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pflash</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='readonly'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='secure'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>yes</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>no</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </loader>
Nov 15 18:32:21 user nova-compute[75634]:   </os>
Nov 15 18:32:21 user nova-compute[75634]:   <cpu>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-passthrough' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='hostPassthroughMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='maximum' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='maximumMigratable'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>on</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>off</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='host-model' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <vendor>Intel</vendor>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ss'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='vmx'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pcid'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='hypervisor'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arat'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='umip'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='md-clear'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='invtsc'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibpb'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='ibrs'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-stibp'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='rsba'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='erms'/>
Nov 15 18:32:21 user nova-compute[75634]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:     <mode name='custom' supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>qemu64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>qemu32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>phenom</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>pentium</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>n270</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm64</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>kvm32</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>coreduo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>core2duo</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>athlon</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Westmere</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Snowridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Skylake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>SandyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Penryn</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G5</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G4</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G3</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Opteron_G2</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Opteron_G1</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>IvyBridge</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Icelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Haswell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Rome</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-Milan</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>EPYC</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Dhyana</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cooperlake</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>Conroe</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='no'>Broadwell</model>
Nov 15 18:32:21 user nova-compute[75634]:       <model usable='yes'>486</model>
Nov 15 18:32:21 user nova-compute[75634]:     </mode>
Nov 15 18:32:21 user nova-compute[75634]:   </cpu>
Nov 15 18:32:21 user nova-compute[75634]:   <memoryBacking supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:     <enum name='sourceType'>
Nov 15 18:32:21 user nova-compute[75634]:       <value>file</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>anonymous</value>
Nov 15 18:32:21 user nova-compute[75634]:       <value>memfd</value>
Nov 15 18:32:21 user nova-compute[75634]:     </enum>
Nov 15 18:32:21 user nova-compute[75634]:   </memoryBacking>
Nov 15 18:32:21 user nova-compute[75634]:   <devices>
Nov 15 18:32:21 user nova-compute[75634]:     <disk supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='diskDevice'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>disk</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cdrom</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>floppy</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>lun</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='bus'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>fdc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sata</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </disk>
Nov 15 18:32:21 user nova-compute[75634]:     <graphics supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='type'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>sdl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vnc</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>spice</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egl-headless</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </graphics>
Nov 15 18:32:21 user nova-compute[75634]:     <video supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='modelType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>cirrus</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>vmvga</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>qxl</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>none</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>bochs</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>ramfb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </video>
Nov 15 18:32:21 user nova-compute[75634]:     <hostdev supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='mode'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>subsystem</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='startupPolicy'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>default</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>mandatory</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>requisite</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>optional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='subsysType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>usb</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>pci</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>scsi</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='capsType'/>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='pciBackend'/>
Nov 15 18:32:21 user nova-compute[75634]:     </hostdev>
Nov 15 18:32:21 user nova-compute[75634]:     <rng supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtio-non-transitional</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>random</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>egd</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>builtin</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </rng>
Nov 15 18:32:21 user nova-compute[75634]:     <filesystem supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='driverType'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>path</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>handle</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>virtiofs</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </filesystem>
Nov 15 18:32:21 user nova-compute[75634]:     <tpm supported='yes'>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='model'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-tis</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>tpm-crb</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:       <enum name='backendModel'>
Nov 15 18:32:21 user nova-compute[75634]:         <value>passthrough</value>
Nov 15 18:32:21 user nova-compute[75634]:         <value>emulator</value>
Nov 15 18:32:21 user nova-compute[75634]:       </enum>
Nov 15 18:32:21 user nova-compute[75634]:     </tpm>
Nov 15 18:32:21 user nova-compute[75634]:   </devices>
Nov 15 18:32:21 user nova-compute[75634]:   <features>
Nov 15 18:32:21 user nova-compute[75634]:     <gic supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:     <vmcoreinfo supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <genid supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backingStoreInput supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <backup supported='yes'/>
Nov 15 18:32:21 user nova-compute[75634]:     <sev supported='no'/>
Nov 15 18:32:21 user nova-compute[75634]:   </features>
Nov 15 18:32:21 user nova-compute[75634]: </domainCapabilities>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75634) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75634) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Checking secure boot support for host arch (x86_64) {{(pid=75634) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Secure Boot support detected
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] cpu compare xml: <cpu match="exact">
Nov 15 18:32:21 user nova-compute[75634]:   <model>Nehalem</model>
Nov 15 18:32:21 user nova-compute[75634]: </cpu>
Nov 15 18:32:21 user nova-compute[75634]:  {{(pid=75634) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.virt.node [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Generated node identity 505e734b-a7a7-4ad8-9307-19cae75d31aa
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.virt.node [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Wrote node identity 505e734b-a7a7-4ad8-9307-19cae75d31aa to /opt/stack/data/nova/compute_id
Nov 15 18:32:21 user nova-compute[75634]: WARNING nova.compute.manager [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Compute nodes ['505e734b-a7a7-4ad8-9307-19cae75d31aa'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.compute.manager [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 18:32:21 user nova-compute[75634]: WARNING nova.compute.manager [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 18:32:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:32:21 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:32:21 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:32:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Hypervisor/Node resource view: name=user free_ram=10934MB free_disk=26.12270736694336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:32:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:32:21 user nova-compute[75634]: WARNING nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] No compute node record for user:505e734b-a7a7-4ad8-9307-19cae75d31aa: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 505e734b-a7a7-4ad8-9307-19cae75d31aa could not be found.
Nov 15 18:32:21 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Compute node record created for user:user with uuid: 505e734b-a7a7-4ad8-9307-19cae75d31aa
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:32:22 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] [req-75647051-f868-4d00-a854-c7043d5b5b94] Created resource provider record via placement API for resource provider with UUID 505e734b-a7a7-4ad8-9307-19cae75d31aa and name user.
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75634) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 18:32:22 user nova-compute[75634]: INFO nova.virt.libvirt.host [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] kernel doesn't support AMD SEV
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Libvirt baseline CPU <cpu>
Nov 15 18:32:22 user nova-compute[75634]:   <arch>x86_64</arch>
Nov 15 18:32:22 user nova-compute[75634]:   <model>Nehalem</model>
Nov 15 18:32:22 user nova-compute[75634]:   <vendor>Intel</vendor>
Nov 15 18:32:22 user nova-compute[75634]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 18:32:22 user nova-compute[75634]: </cpu>
Nov 15 18:32:22 user nova-compute[75634]:  {{(pid=75634) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Updated inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Updating resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa generation from 0 to 1 during operation: update_inventory {{(pid=75634) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Updating resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa generation from 1 to 2 during operation: update_traits {{(pid=75634) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.service [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Creating RPC server for service compute {{(pid=75634) start /opt/stack/nova/nova/service.py:182}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.service [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] Join ServiceGroup membership for this service compute {{(pid=75634) start /opt/stack/nova/nova/service.py:199}}
Nov 15 18:32:22 user nova-compute[75634]: DEBUG nova.servicegroup.drivers.db [None req-e4b00a73-ccc3-49ea-83a3-3c37dbb8946c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75634) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:33:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:33:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:33:19 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=10285MB free_disk=26.026500701904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:33:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:33:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:34:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:34:14 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:34:14 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=26.09091567993164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:34:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:34:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:35:13 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:35:13 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=10322MB free_disk=25.843429565429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:35:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:35:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:35:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:35:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:35:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:35:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:35:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:36:14 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:14 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=9591MB free_disk=25.872127532958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:36:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:36:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:36:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:25 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:25 user nova-compute[75634]: INFO nova.compute.claims [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Claim successful on node user
Nov 15 18:36:25 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Creating image(s)
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "/opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "/opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG nova.policy [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099e827d7f0847fba5644d6f5eef6743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efda14818c224f2382438fcf2c1c39c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG nova.virt.images [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] 2c2255c9-a9c5-4496-8a92-18849f2ce081 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.part /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.part /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.converted" returned: 0 in 0.153s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.960s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:27 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnh7pp85a/privsep.sock']
Nov 15 18:36:27 user sudo[84883]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnh7pp85a/privsep.sock
Nov 15 18:36:27 user sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 18:36:28 user sudo[84883]: pam_unix(sudo:session): session closed for user root
Nov 15 18:36:28 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Spawned new privsep daemon via rootwrap
Nov 15 18:36:28 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 18:36:28 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 18:36:28 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 18:36:28 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84900
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:29 user nova-compute[75634]: INFO nova.compute.claims [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Claim successful on node user
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.291s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Successfully created port: 89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.293s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk 1073741824" returned: 0 in 0.048s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.231s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Cannot resize image /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Ensure instance console log exists: /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.856s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.700s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:30 user nova-compute[75634]: INFO nova.compute.claims [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Claim successful on node user
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Creating image(s)
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.106s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:30 user nova-compute[75634]: INFO nova.compute.claims [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Claim successful on node user
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.policy [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32a76663d88d4a4ea090919a67c801a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bed672b3528475bb3bbe7f4eecfd7c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:30 user nova-compute[75634]: DEBUG nova.policy [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6642c8d206564bc5b510ce6ead09fc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d2c43038b241429feffe23bbbf4f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk 1073741824" returned: 0 in 0.054s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Creating image(s)
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.216s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.417s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.457s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Cannot resize image /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Ensure instance console log exists: /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk 1073741824" returned: 0 in 0.123s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.550s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:32 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Creating image(s)
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "/opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.policy [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ebb5c4075034b1482d50a9ff5dd990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb5adcf609a4fd7a67d3574243cc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Cannot resize image /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Successfully updated port: 89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk 1073741824" returned: 0 in 0.046s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquired lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Successfully created port: 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Cannot resize image /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Ensure instance console log exists: /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received event network-changed-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Refreshing instance network info cache due to event network-changed-89b9a43a-f31f-484e-9f87-2e18abbf17cf. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] Acquiring lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updating instance_info_cache with network_info: [{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Releasing lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Instance network_info: |[{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] Acquired lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Refreshing network info cache for port 89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Start _get_guest_xml network_info=[{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:34 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:34 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-310558690',display_name='tempest-ServersNegativeTestJSON-server-310558690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-310558690',id=1,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-jnb7hd8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:26Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=b5ea2fd0-4c87-410a-bd2c-9215f1dc0016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lazy-loading 'pci_devices' on Instance uuid b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Successfully created port: 3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:34 user nova-compute[75634]:   <uuid>b5ea2fd0-4c87-410a-bd2c-9215f1dc0016</uuid>
Nov 15 18:36:34 user nova-compute[75634]:   <name>instance-00000001</name>
Nov 15 18:36:34 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:34 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:34 user nova-compute[75634]:   <metadata>
Nov 15 18:36:34 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:34 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:name>tempest-ServersNegativeTestJSON-server-310558690</nova:name>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:34</nova:creationTime>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:34 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:34 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:user uuid="099e827d7f0847fba5644d6f5eef6743">tempest-ServersNegativeTestJSON-1798425367-project-member</nova:user>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:project uuid="efda14818c224f2382438fcf2c1c39c5">tempest-ServersNegativeTestJSON-1798425367</nova:project>
Nov 15 18:36:34 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:34 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:34 user nova-compute[75634]:         <nova:port uuid="89b9a43a-f31f-484e-9f87-2e18abbf17cf">
Nov 15 18:36:34 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 18:36:34 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:34 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:34 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:34 user nova-compute[75634]:   </metadata>
Nov 15 18:36:34 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:34 user nova-compute[75634]:     <system>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="serial">b5ea2fd0-4c87-410a-bd2c-9215f1dc0016</entry>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="uuid">b5ea2fd0-4c87-410a-bd2c-9215f1dc0016</entry>
Nov 15 18:36:34 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:34 user nova-compute[75634]:     </system>
Nov 15 18:36:34 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:34 user nova-compute[75634]:   <os>
Nov 15 18:36:34 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:34 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:34 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:34 user nova-compute[75634]:   </os>
Nov 15 18:36:34 user nova-compute[75634]:   <features>
Nov 15 18:36:34 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:34 user nova-compute[75634]:     <apic/>
Nov 15 18:36:34 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:34 user nova-compute[75634]:   </features>
Nov 15 18:36:34 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:34 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:34 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:34 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:34 user nova-compute[75634]:   </clock>
Nov 15 18:36:34 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:34 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:34 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:34 user nova-compute[75634]:   </cpu>
Nov 15 18:36:34 user nova-compute[75634]:   <devices>
Nov 15 18:36:34 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:34 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:34 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk"/>
Nov 15 18:36:34 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:34 user nova-compute[75634]:     </disk>
Nov 15 18:36:34 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:34 user nova-compute[75634]:       <mac address="fa:16:3e:05:17:fe"/>
Nov 15 18:36:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:34 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:34 user nova-compute[75634]:       <target dev="tap89b9a43a-f3"/>
Nov 15 18:36:34 user nova-compute[75634]:     </interface>
Nov 15 18:36:34 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:34 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/console.log" append="off"/>
Nov 15 18:36:34 user nova-compute[75634]:     </serial>
Nov 15 18:36:34 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:34 user nova-compute[75634]:     <video>
Nov 15 18:36:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:34 user nova-compute[75634]:     </video>
Nov 15 18:36:34 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:34 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:34 user nova-compute[75634]:     </rng>
Nov 15 18:36:34 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:34 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:34 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:34 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:34 user nova-compute[75634]:   </devices>
Nov 15 18:36:34 user nova-compute[75634]: </domain>
Nov 15 18:36:34 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-310558690',display_name='tempest-ServersNegativeTestJSON-server-310558690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-310558690',id=1,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-jnb7hd8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:26Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=b5ea2fd0-4c87-410a-bd2c-9215f1dc0016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG os_vif [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Created schema index Interface.name {{(pid=75634) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Created schema index Port.name {{(pid=75634) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Created schema index Bridge.name {{(pid=75634) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Successfully updated port: 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [POLLOUT] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9fde5a9-1f78-5597-8b03-bd689ff5f1af', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:34 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpq8lwrd_3/privsep.sock']
Nov 15 18:36:34 user sudo[85014]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpq8lwrd_3/privsep.sock
Nov 15 18:36:34 user sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-changed-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing instance network info cache due to event network-changed-5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance network_info: |[{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing network info cache for port 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start _get_guest_xml network_info=[{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:35 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:35 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB7iOyoiiOgyqpFSqgBP8vgPi0Pl4dT/C57yqn88S6pO7+tpJCZE1OZQ6q9PuMUlXlNZXb3PuJcLqM6M+WYtpymDEhY7IQ42Cf9jJTK4q7hhK+ku29pS2DUnARQGkf6pA==',key_name='tempest-keypair-1072552389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_devices' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Successfully created port: 32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:35 user nova-compute[75634]:   <uuid>d14a0c65-0ba1-4919-80b8-5295e100a7f7</uuid>
Nov 15 18:36:35 user nova-compute[75634]:   <name>instance-00000002</name>
Nov 15 18:36:35 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:35 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:35 user nova-compute[75634]:   <metadata>
Nov 15 18:36:35 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:35 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-12552747</nova:name>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:35</nova:creationTime>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:35 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:35 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:user uuid="6642c8d206564bc5b510ce6ead09fc2c">tempest-AttachVolumeShelveTestJSON-1234122392-project-member</nova:user>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:project uuid="38d2c43038b241429feffe23bbbf4f1d">tempest-AttachVolumeShelveTestJSON-1234122392</nova:project>
Nov 15 18:36:35 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:35 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:35 user nova-compute[75634]:         <nova:port uuid="5abcd712-2686-44c8-9798-983e094f7649">
Nov 15 18:36:35 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:36:35 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:35 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:35 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:35 user nova-compute[75634]:   </metadata>
Nov 15 18:36:35 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:35 user nova-compute[75634]:     <system>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="serial">d14a0c65-0ba1-4919-80b8-5295e100a7f7</entry>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="uuid">d14a0c65-0ba1-4919-80b8-5295e100a7f7</entry>
Nov 15 18:36:35 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:35 user nova-compute[75634]:     </system>
Nov 15 18:36:35 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:35 user nova-compute[75634]:   <os>
Nov 15 18:36:35 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:35 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:35 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:35 user nova-compute[75634]:   </os>
Nov 15 18:36:35 user nova-compute[75634]:   <features>
Nov 15 18:36:35 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:35 user nova-compute[75634]:     <apic/>
Nov 15 18:36:35 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:35 user nova-compute[75634]:   </features>
Nov 15 18:36:35 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:35 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:35 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:35 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:35 user nova-compute[75634]:   </clock>
Nov 15 18:36:35 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:35 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:35 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:35 user nova-compute[75634]:   </cpu>
Nov 15 18:36:35 user nova-compute[75634]:   <devices>
Nov 15 18:36:35 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:35 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:35 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk"/>
Nov 15 18:36:35 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:35 user nova-compute[75634]:     </disk>
Nov 15 18:36:35 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:35 user nova-compute[75634]:       <mac address="fa:16:3e:fa:c4:06"/>
Nov 15 18:36:35 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:35 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:35 user nova-compute[75634]:       <target dev="tap5abcd712-26"/>
Nov 15 18:36:35 user nova-compute[75634]:     </interface>
Nov 15 18:36:35 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:35 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/console.log" append="off"/>
Nov 15 18:36:35 user nova-compute[75634]:     </serial>
Nov 15 18:36:35 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:35 user nova-compute[75634]:     <video>
Nov 15 18:36:35 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:35 user nova-compute[75634]:     </video>
Nov 15 18:36:35 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:35 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:35 user nova-compute[75634]:     </rng>
Nov 15 18:36:35 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:35 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:35 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:35 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:35 user nova-compute[75634]:   </devices>
Nov 15 18:36:35 user nova-compute[75634]: </domain>
Nov 15 18:36:35 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB7iOyoiiOgyqpFSqgBP8vgPi0Pl4dT/C57yqn88S6pO7+tpJCZE1OZQ6q9PuMUlXlNZXb3PuJcLqM6M+WYtpymDEhY7IQ42Cf9jJTK4q7hhK+ku29pS2DUnARQGkf6pA==',key_name='tempest-keypair-1072552389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG os_vif [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2eadac7-6633-5b3d-8e8b-eb363fb9060f', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updated VIF entry in instance network info cache for port 89b9a43a-f31f-484e-9f87-2e18abbf17cf. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updating instance_info_cache with network_info: [{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e71d985d-9c9f-404b-9ad3-c3c63a837355 req-488f051b-94e4-43d6-9213-2e96739932fa service nova] Releasing lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:35 user sudo[85014]: pam_unix(sudo:session): session closed for user root
Nov 15 18:36:35 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Spawned new privsep daemon via rootwrap
Nov 15 18:36:35 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 18:36:35 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 18:36:35 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 18:36:35 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85017
Nov 15 18:36:36 user nova-compute[75634]: WARNING oslo_privsep.priv_context [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] privsep daemon already running
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updated VIF entry in instance network info cache for port 5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3382240-5c01-405f-86da-9c066be5a7ce req-8a3d91ec-2d93-4721-bb4d-14bf2e3ded61 service nova] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5abcd712-26, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5abcd712-26, col_values=(('qos', UUID('7deacd5b-b32b-4480-9c5d-cb8f2d3012d6')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5abcd712-26, col_values=(('external_ids', {'iface-id': '5abcd712-2686-44c8-9798-983e094f7649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:c4:06', 'vm-uuid': 'd14a0c65-0ba1-4919-80b8-5295e100a7f7'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: INFO os_vif [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26')
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89b9a43a-f3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89b9a43a-f3, col_values=(('qos', UUID('0d87f1c9-4663-484d-ad79-ace67a4efa91')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89b9a43a-f3, col_values=(('external_ids', {'iface-id': '89b9a43a-f31f-484e-9f87-2e18abbf17cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:17:fe', 'vm-uuid': 'b5ea2fd0-4c87-410a-bd2c-9215f1dc0016'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:36 user nova-compute[75634]: INFO os_vif [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3')
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No VIF found with MAC fa:16:3e:fa:c4:06, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] No VIF found with MAC fa:16:3e:05:17:fe, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Successfully updated port: 3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-changed-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Refreshing instance network info cache due to event network-changed-3788bac0-17f5-41ed-889d-2649ea453783. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Successfully updated port: 32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance network_info: |[{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.neutron [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Refreshing network info cache for port 3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start _get_guest_xml network_info=[{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:37 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:37 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'pci_devices' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:37 user nova-compute[75634]:   <uuid>46998ac1-8bf2-4277-a9cd-f8ecf53c5576</uuid>
Nov 15 18:36:37 user nova-compute[75634]:   <name>instance-00000003</name>
Nov 15 18:36:37 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:37 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:37 user nova-compute[75634]:   <metadata>
Nov 15 18:36:37 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:37 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherB-server-2001600215</nova:name>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:37</nova:creationTime>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:37 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:37 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:user uuid="32a76663d88d4a4ea090919a67c801a8">tempest-ServerActionsTestOtherB-1858282954-project-member</nova:user>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:project uuid="7bed672b3528475bb3bbe7f4eecfd7c5">tempest-ServerActionsTestOtherB-1858282954</nova:project>
Nov 15 18:36:37 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:37 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:37 user nova-compute[75634]:         <nova:port uuid="3788bac0-17f5-41ed-889d-2649ea453783">
Nov 15 18:36:37 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:36:37 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:37 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:37 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:37 user nova-compute[75634]:   </metadata>
Nov 15 18:36:37 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:37 user nova-compute[75634]:     <system>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="serial">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="uuid">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:36:37 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:37 user nova-compute[75634]:     </system>
Nov 15 18:36:37 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:37 user nova-compute[75634]:   <os>
Nov 15 18:36:37 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:37 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:37 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:37 user nova-compute[75634]:   </os>
Nov 15 18:36:37 user nova-compute[75634]:   <features>
Nov 15 18:36:37 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:37 user nova-compute[75634]:     <apic/>
Nov 15 18:36:37 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:37 user nova-compute[75634]:   </features>
Nov 15 18:36:37 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:37 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:37 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:37 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:37 user nova-compute[75634]:   </clock>
Nov 15 18:36:37 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:37 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:37 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:37 user nova-compute[75634]:   </cpu>
Nov 15 18:36:37 user nova-compute[75634]:   <devices>
Nov 15 18:36:37 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:37 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:37 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk"/>
Nov 15 18:36:37 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:37 user nova-compute[75634]:     </disk>
Nov 15 18:36:37 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:37 user nova-compute[75634]:       <mac address="fa:16:3e:96:86:92"/>
Nov 15 18:36:37 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:37 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:37 user nova-compute[75634]:       <target dev="tap3788bac0-17"/>
Nov 15 18:36:37 user nova-compute[75634]:     </interface>
Nov 15 18:36:37 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:37 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/console.log" append="off"/>
Nov 15 18:36:37 user nova-compute[75634]:     </serial>
Nov 15 18:36:37 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:37 user nova-compute[75634]:     <video>
Nov 15 18:36:37 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:37 user nova-compute[75634]:     </video>
Nov 15 18:36:37 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:37 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:37 user nova-compute[75634]:     </rng>
Nov 15 18:36:37 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:37 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:37 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:37 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:37 user nova-compute[75634]:   </devices>
Nov 15 18:36:37 user nova-compute[75634]: </domain>
Nov 15 18:36:37 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG os_vif [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50831446-03e2-5796-952a-8afb1664d053', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3788bac0-17, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3788bac0-17, col_values=(('qos', UUID('3d82818a-009e-4e65-b927-9595dd73b33e')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3788bac0-17, col_values=(('external_ids', {'iface-id': '3788bac0-17f5-41ed-889d-2649ea453783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:86:92', 'vm-uuid': '46998ac1-8bf2-4277-a9cd-f8ecf53c5576'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:37 user nova-compute[75634]: INFO os_vif [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No VIF found with MAC fa:16:3e:96:86:92, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Instance network_info: |[{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Start _get_guest_xml network_info=[{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1228526431',display_name='tempest-ServerActionsTestOtherA-server-1228526431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1228526431',id=4,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-4nq50hc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=b44cd307-ffbe-4ccd-996f-299ce61b60a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'pci_devices' on Instance uuid b44cd307-ffbe-4ccd-996f-299ce61b60a6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:38 user nova-compute[75634]:   <uuid>b44cd307-ffbe-4ccd-996f-299ce61b60a6</uuid>
Nov 15 18:36:38 user nova-compute[75634]:   <name>instance-00000004</name>
Nov 15 18:36:38 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:38 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:38 user nova-compute[75634]:   <metadata>
Nov 15 18:36:38 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:38 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherA-server-1228526431</nova:name>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:38</nova:creationTime>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:38 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:38 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:user uuid="3ebb5c4075034b1482d50a9ff5dd990b">tempest-ServerActionsTestOtherA-1839012723-project-member</nova:user>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:project uuid="0fb5adcf609a4fd7a67d3574243cc920">tempest-ServerActionsTestOtherA-1839012723</nova:project>
Nov 15 18:36:38 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:38 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:38 user nova-compute[75634]:         <nova:port uuid="32c5d0ab-3ab1-4cee-90d7-22298c5e753d">
Nov 15 18:36:38 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:36:38 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:38 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:38 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:38 user nova-compute[75634]:   </metadata>
Nov 15 18:36:38 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:38 user nova-compute[75634]:     <system>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="serial">b44cd307-ffbe-4ccd-996f-299ce61b60a6</entry>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="uuid">b44cd307-ffbe-4ccd-996f-299ce61b60a6</entry>
Nov 15 18:36:38 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:38 user nova-compute[75634]:     </system>
Nov 15 18:36:38 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:38 user nova-compute[75634]:   <os>
Nov 15 18:36:38 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:38 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:38 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:38 user nova-compute[75634]:   </os>
Nov 15 18:36:38 user nova-compute[75634]:   <features>
Nov 15 18:36:38 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:38 user nova-compute[75634]:     <apic/>
Nov 15 18:36:38 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:38 user nova-compute[75634]:   </features>
Nov 15 18:36:38 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:38 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:38 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:38 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:38 user nova-compute[75634]:   </clock>
Nov 15 18:36:38 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:38 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:38 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:38 user nova-compute[75634]:   </cpu>
Nov 15 18:36:38 user nova-compute[75634]:   <devices>
Nov 15 18:36:38 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:38 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:38 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk"/>
Nov 15 18:36:38 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:38 user nova-compute[75634]:     </disk>
Nov 15 18:36:38 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:38 user nova-compute[75634]:       <mac address="fa:16:3e:42:1d:0c"/>
Nov 15 18:36:38 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:38 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:38 user nova-compute[75634]:       <target dev="tap32c5d0ab-3a"/>
Nov 15 18:36:38 user nova-compute[75634]:     </interface>
Nov 15 18:36:38 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:38 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/console.log" append="off"/>
Nov 15 18:36:38 user nova-compute[75634]:     </serial>
Nov 15 18:36:38 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:38 user nova-compute[75634]:     <video>
Nov 15 18:36:38 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:38 user nova-compute[75634]:     </video>
Nov 15 18:36:38 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:38 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:38 user nova-compute[75634]:     </rng>
Nov 15 18:36:38 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:38 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:38 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:38 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:38 user nova-compute[75634]:   </devices>
Nov 15 18:36:38 user nova-compute[75634]: </domain>
Nov 15 18:36:38 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1228526431',display_name='tempest-ServerActionsTestOtherA-server-1228526431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1228526431',id=4,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-4nq50hc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=b44cd307-ffbe-4ccd-996f-299ce61b60a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG os_vif [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d858885-e896-5321-bdd3-b5bb172d1fbd', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c5d0ab-3a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32c5d0ab-3a, col_values=(('qos', UUID('19b99d9c-97df-4310-bb47-a7dd139ff156')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32c5d0ab-3a, col_values=(('external_ids', {'iface-id': '32c5d0ab-3ab1-4cee-90d7-22298c5e753d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:1d:0c', 'vm-uuid': 'b44cd307-ffbe-4ccd-996f-299ce61b60a6'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:38 user nova-compute[75634]: INFO os_vif [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a')
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:42:1d:0c, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updated VIF entry in instance network info cache for port 3788bac0-17f5-41ed-889d-2649ea453783. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-73b5ed99-3edc-4247-b872-3211853b22ec req-762d27dd-1ec4-4517-9992-94991ff70030 service nova] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing instance network info cache due to event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated VIF entry in instance network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59f987f0-c3dd-45d5-b881-93b1f91e009b req-be0b605c-99b5-4538-8a12-08dd48c6d8c1 service nova] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:40 user nova-compute[75634]: INFO nova.compute.claims [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Claim successful on node user
Nov 15 18:36:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Creating image(s)
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "/opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "/opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.policy [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a3dc42740164b32b830f419a10be05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3250b3723c8a4a1db318035e0a7477df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk 1073741824" returned: 0 in 0.049s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Cannot resize image /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Ensure instance console log exists: /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:42 user nova-compute[75634]: INFO nova.compute.claims [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Claim successful on node user
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Successfully created port: 711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG nova.policy [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f6f4b48ddb64bc6b6b8d3236e772686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f21c0a07dd454dab73c5a21c8c86ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Creating image(s)
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "/opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "/opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.225s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk 1073741824" returned: 0 in 0.058s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.241s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance spawned successfully.
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Cannot resize image /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Ensure instance console log exists: /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Successfully updated port: 711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquired lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-changed-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Refreshing instance network info cache due to event network-changed-711c0187-65d5-4792-bb1c-1d7da8200967. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] Acquiring lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:44 user nova-compute[75634]: INFO nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Took 13.55 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Successfully created port: 7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.compute.manager [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Took 15.57 seconds to build instance.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0f12854a-a916-4b87-ac9d-33f5b08fe2c9 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.965s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating instance_info_cache with network_info: [{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Releasing lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Instance network_info: |[{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] Acquired lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Refreshing network info cache for port 711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Start _get_guest_xml network_info=[{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1840089197',display_name='tempest-VolumesAdminNegativeTest-server-1840089197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1840089197',id=5,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ04i4SEsmj6H1udZSBVW7MTdsmBlDiT6HKHsjP/3V+znzkxjVdplK2G4dHNNlDptWnSMx8HD5wHyAaghAKtBEfO3dBB0zqJOlXzePTtpfGxixxD0Ds8ik29/cUpOIJow==',key_name='tempest-keypair-1976255953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-32njrp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a3dc42740164b32b830f419a10be05e',uuid=fc102a8d-d379-40c7-9b38-ed423ee1a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'pci_devices' on Instance uuid fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Instance spawned successfully.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:45 user nova-compute[75634]:   <uuid>fc102a8d-d379-40c7-9b38-ed423ee1a5c7</uuid>
Nov 15 18:36:45 user nova-compute[75634]:   <name>instance-00000005</name>
Nov 15 18:36:45 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:45 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:45 user nova-compute[75634]:   <metadata>
Nov 15 18:36:45 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:45 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1840089197</nova:name>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:45</nova:creationTime>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:45 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:45 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:user uuid="3a3dc42740164b32b830f419a10be05e">tempest-VolumesAdminNegativeTest-671222403-project-member</nova:user>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:project uuid="3250b3723c8a4a1db318035e0a7477df">tempest-VolumesAdminNegativeTest-671222403</nova:project>
Nov 15 18:36:45 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:45 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:45 user nova-compute[75634]:         <nova:port uuid="711c0187-65d5-4792-bb1c-1d7da8200967">
Nov 15 18:36:45 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:36:45 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:45 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:45 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:45 user nova-compute[75634]:   </metadata>
Nov 15 18:36:45 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:45 user nova-compute[75634]:     <system>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="serial">fc102a8d-d379-40c7-9b38-ed423ee1a5c7</entry>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="uuid">fc102a8d-d379-40c7-9b38-ed423ee1a5c7</entry>
Nov 15 18:36:45 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:45 user nova-compute[75634]:     </system>
Nov 15 18:36:45 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:45 user nova-compute[75634]:   <os>
Nov 15 18:36:45 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:45 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:45 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:45 user nova-compute[75634]:   </os>
Nov 15 18:36:45 user nova-compute[75634]:   <features>
Nov 15 18:36:45 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:45 user nova-compute[75634]:     <apic/>
Nov 15 18:36:45 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:45 user nova-compute[75634]:   </features>
Nov 15 18:36:45 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:45 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:45 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:45 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:45 user nova-compute[75634]:   </clock>
Nov 15 18:36:45 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:45 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:45 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:45 user nova-compute[75634]:   </cpu>
Nov 15 18:36:45 user nova-compute[75634]:   <devices>
Nov 15 18:36:45 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:45 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:45 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk"/>
Nov 15 18:36:45 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:45 user nova-compute[75634]:     </disk>
Nov 15 18:36:45 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:45 user nova-compute[75634]:       <mac address="fa:16:3e:09:a7:2f"/>
Nov 15 18:36:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:45 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:45 user nova-compute[75634]:       <target dev="tap711c0187-65"/>
Nov 15 18:36:45 user nova-compute[75634]:     </interface>
Nov 15 18:36:45 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:45 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/console.log" append="off"/>
Nov 15 18:36:45 user nova-compute[75634]:     </serial>
Nov 15 18:36:45 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:45 user nova-compute[75634]:     <video>
Nov 15 18:36:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:45 user nova-compute[75634]:     </video>
Nov 15 18:36:45 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:45 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:45 user nova-compute[75634]:     </rng>
Nov 15 18:36:45 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:45 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:45 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:45 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:45 user nova-compute[75634]:   </devices>
Nov 15 18:36:45 user nova-compute[75634]: </domain>
Nov 15 18:36:45 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1840089197',display_name='tempest-VolumesAdminNegativeTest-server-1840089197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1840089197',id=5,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ04i4SEsmj6H1udZSBVW7MTdsmBlDiT6HKHsjP/3V+znzkxjVdplK2G4dHNNlDptWnSMx8HD5wHyAaghAKtBEfO3dBB0zqJOlXzePTtpfGxixxD0Ds8ik29/cUpOIJow==',key_name='tempest-keypair-1976255953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-32njrp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a3dc42740164b32b830f419a10be05e',uuid=fc102a8d-d379-40c7-9b38-ed423ee1a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG os_vif [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02762c7d-671a-5216-8ae6-f33581fb7e92', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap711c0187-65, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap711c0187-65, col_values=(('qos', UUID('f41953e9-0151-485a-a01c-7225c94b3851')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap711c0187-65, col_values=(('external_ids', {'iface-id': '711c0187-65d5-4792-bb1c-1d7da8200967', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:a7:2f', 'vm-uuid': 'fc102a8d-d379-40c7-9b38-ed423ee1a5c7'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:45 user nova-compute[75634]: INFO os_vif [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65')
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance spawned successfully.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Instance spawned successfully.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No VIF found with MAC fa:16:3e:09:a7:2f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Took 19.44 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:45 user nova-compute[75634]: INFO nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Took 15.21 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:46 user nova-compute[75634]: INFO nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Took 13.91 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:46 user nova-compute[75634]: INFO nova.compute.manager [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Took 21.04 seconds to build instance.
Nov 15 18:36:46 user nova-compute[75634]: INFO nova.compute.manager [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Took 16.82 seconds to build instance.
Nov 15 18:36:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d1b4d04d-4e97-4f79-81c2-435b22942991 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.336s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3f462006-cfbd-4dea-8f98-5b24a99775f4 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.046s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:46 user nova-compute[75634]: INFO nova.compute.manager [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Took 16.91 seconds to build instance.
Nov 15 18:36:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-238c56c0-d956-4de7-a20a-26f356e52e72 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.198s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updated VIF entry in instance network info cache for port 711c0187-65d5-4792-bb1c-1d7da8200967. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating instance_info_cache with network_info: [{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0780ce4a-14b9-4789-9872-55953cf32936 req-d89e4c44-8136-4920-ab24-02e57ced7c70 service nova] Releasing lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Successfully updated port: 7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquired lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-changed-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Refreshing instance network info cache due to event network-changed-7f6513a9-437c-48d7-a512-e6cd0c370628. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] Acquiring lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:47 user nova-compute[75634]: WARNING nova.compute.manager [req-20adf75d-2ce8-4802-9c4c-33a4c5ab5d8b req-98679bc7-cb51-4591-8fb3-a8f5c953a4a2 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state None.
Nov 15 18:36:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updating instance_info_cache with network_info: [{"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Releasing lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Instance network_info: |[{"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] Acquired lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Refreshing network info cache for port 7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Start _get_guest_xml network_info=[{"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:48 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:48 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1363070356',display_name='tempest-TestVolumeSwap-server-1363070356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1363070356',id=6,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI2egJ/AhiPG2BX9cTTtyPnRBq6HcvMT/tVtGNQru2feCkrhtKoVrZcFKRan3c+EbVaV1KOqHADodTsvN314sQZN1fNtvC1cI1A1NNL8uS5dfHH9522sy/3vBzoIwJs3A==',key_name='tempest-keypair-1648725269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f21c0a07dd454dab73c5a21c8c86ee',ramdisk_id='',reservation_id='r-8y7jec4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-93028597',owner_user_name='tempest-TestVolumeSwap-93028597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f6f4b48ddb64bc6b6b8d3236e772686',uuid=7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converting VIF {"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.objects.instance [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:48 user nova-compute[75634]:   <uuid>7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e</uuid>
Nov 15 18:36:48 user nova-compute[75634]:   <name>instance-00000006</name>
Nov 15 18:36:48 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:48 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:48 user nova-compute[75634]:   <metadata>
Nov 15 18:36:48 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:48 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:name>tempest-TestVolumeSwap-server-1363070356</nova:name>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:48</nova:creationTime>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:48 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:48 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:user uuid="9f6f4b48ddb64bc6b6b8d3236e772686">tempest-TestVolumeSwap-93028597-project-member</nova:user>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:project uuid="d5f21c0a07dd454dab73c5a21c8c86ee">tempest-TestVolumeSwap-93028597</nova:project>
Nov 15 18:36:48 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:48 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:48 user nova-compute[75634]:         <nova:port uuid="7f6513a9-437c-48d7-a512-e6cd0c370628">
Nov 15 18:36:48 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 18:36:48 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:48 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:48 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:48 user nova-compute[75634]:   </metadata>
Nov 15 18:36:48 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:48 user nova-compute[75634]:     <system>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="serial">7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e</entry>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="uuid">7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e</entry>
Nov 15 18:36:48 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:48 user nova-compute[75634]:     </system>
Nov 15 18:36:48 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:48 user nova-compute[75634]:   <os>
Nov 15 18:36:48 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:48 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:48 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:48 user nova-compute[75634]:   </os>
Nov 15 18:36:48 user nova-compute[75634]:   <features>
Nov 15 18:36:48 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:48 user nova-compute[75634]:     <apic/>
Nov 15 18:36:48 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:48 user nova-compute[75634]:   </features>
Nov 15 18:36:48 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:48 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:48 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:48 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:48 user nova-compute[75634]:   </clock>
Nov 15 18:36:48 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:48 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:48 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:48 user nova-compute[75634]:   </cpu>
Nov 15 18:36:48 user nova-compute[75634]:   <devices>
Nov 15 18:36:48 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:48 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:48 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk"/>
Nov 15 18:36:48 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:48 user nova-compute[75634]:     </disk>
Nov 15 18:36:48 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:48 user nova-compute[75634]:       <mac address="fa:16:3e:5f:b1:45"/>
Nov 15 18:36:48 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:48 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:48 user nova-compute[75634]:       <target dev="tap7f6513a9-43"/>
Nov 15 18:36:48 user nova-compute[75634]:     </interface>
Nov 15 18:36:48 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:48 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/console.log" append="off"/>
Nov 15 18:36:48 user nova-compute[75634]:     </serial>
Nov 15 18:36:48 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:48 user nova-compute[75634]:     <video>
Nov 15 18:36:48 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:48 user nova-compute[75634]:     </video>
Nov 15 18:36:48 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:48 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:48 user nova-compute[75634]:     </rng>
Nov 15 18:36:48 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:48 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:48 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:48 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:48 user nova-compute[75634]:   </devices>
Nov 15 18:36:48 user nova-compute[75634]: </domain>
Nov 15 18:36:48 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1363070356',display_name='tempest-TestVolumeSwap-server-1363070356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1363070356',id=6,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI2egJ/AhiPG2BX9cTTtyPnRBq6HcvMT/tVtGNQru2feCkrhtKoVrZcFKRan3c+EbVaV1KOqHADodTsvN314sQZN1fNtvC1cI1A1NNL8uS5dfHH9522sy/3vBzoIwJs3A==',key_name='tempest-keypair-1648725269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f21c0a07dd454dab73c5a21c8c86ee',ramdisk_id='',reservation_id='r-8y7jec4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-93028597',owner_user_name='tempest-TestVolumeSwap-93028597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f6f4b48ddb64bc6b6b8d3236e772686',uuid=7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converting VIF {"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG os_vif [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eddbd71e-37d9-5257-852d-57b7c42e2dff', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f6513a9-43, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f6513a9-43, col_values=(('qos', UUID('1a0e1693-1d15-49c6-b030-127286ae850f')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f6513a9-43, col_values=(('external_ids', {'iface-id': '7f6513a9-437c-48d7-a512-e6cd0c370628', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:b1:45', 'vm-uuid': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:48 user nova-compute[75634]: INFO os_vif [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43')
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] No VIF found with MAC fa:16:3e:5f:b1:45, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:49 user nova-compute[75634]: WARNING nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state None.
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] No waiting events found dispatching network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:49 user nova-compute[75634]: WARNING nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received unexpected event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d for instance with vm_state active and task_state None.
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] No waiting events found dispatching network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:49 user nova-compute[75634]: WARNING nova.compute.manager [req-f2f98bc9-12ff-4943-817f-7f9a7f38862c req-4e437b91-5d0b-49be-9f89-ab536b182b8f service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received unexpected event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d for instance with vm_state active and task_state None.
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updated VIF entry in instance network info cache for port 7f6513a9-437c-48d7-a512-e6cd0c370628. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updating instance_info_cache with network_info: [{"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1b3366ee-5f3f-46cc-a43a-4b502ef6dfbb req-8d43acd8-edb1-4534-99d5-b4cbbec0b102 service nova] Releasing lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Instance spawned successfully.
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:50 user nova-compute[75634]: INFO nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Took 9.92 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:51 user nova-compute[75634]: INFO nova.compute.manager [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Took 10.92 seconds to build instance.
Nov 15 18:36:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-664fdb01-f3ba-488c-a73e-9bc3937051d3 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:51 user nova-compute[75634]: INFO nova.compute.claims [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Claim successful on node user
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Creating image(s)
Nov 15 18:36:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG nova.policy [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f47155df59f44ec1aff630140493b530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c94de1ba84426900d882f68f2c6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.378s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.356s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk 1073741824" returned: 0 in 0.133s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.507s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:53 user nova-compute[75634]: INFO nova.compute.claims [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Claim successful on node user
Nov 15 18:36:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.424s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Cannot resize image /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Ensure instance console log exists: /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:36:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Instance spawned successfully.
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:54 user nova-compute[75634]: INFO nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Took 11.65 seconds to spawn the instance on the hypervisor.
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.967s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Successfully created port: 1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:55 user nova-compute[75634]: INFO nova.compute.manager [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Took 12.70 seconds to build instance.
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-06170925-21bd-4c56-a84d-05690999ea1c tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.821s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.policy [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e1a64114ef94c81b3592a30d8418aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90fa379a4301426998176df23feda180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:36:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Creating image(s)
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] No waiting events found dispatching network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:56 user nova-compute[75634]: WARNING nova.compute.manager [req-50d25a0f-fb08-4bf8-9eda-739c798dea0e req-09f5c0e9-c080-44c1-bc2c-d1c4ab9078ab service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received unexpected event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 for instance with vm_state active and task_state None.
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.part --force-share --output=json" returned: 0 in 0.342s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG nova.virt.images [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] fcb6c264-52bf-42bc-8eaf-01300f6d70c2 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.part /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.part /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.converted" returned: 0 in 0.259s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7.converted --force-share --output=json" returned: 0 in 0.309s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.974s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json" returned: 0 in 0.368s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7,backing_fmt=raw /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7,backing_fmt=raw /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk 1073741824" returned: 0 in 0.089s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "fffde95de9686bcf2be82ea435fd6d044ea255d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.463s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:58 user nova-compute[75634]: INFO nova.compute.claims [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Claim successful on node user
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7 --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] No waiting events found dispatching network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:36:58 user nova-compute[75634]: WARNING nova.compute.manager [req-9a00ffd6-aa29-4003-ac0a-bc730411d120 req-f8d55b27-e7e4-4875-a256-6939269cd9b7 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received unexpected event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 for instance with vm_state active and task_state None.
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Successfully updated port: 1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.398s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Cannot resize image /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Ensure instance console log exists: /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-changed-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing instance network info cache due to event network-changed-1d52672f-2f92-4487-b730-82d4a60db5fc. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:36:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.178s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.870s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:36:59 user nova-compute[75634]: INFO nova.compute.claims [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Claim successful on node user
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:36:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Successfully created port: d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.policy [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ddac01d950041a99517eed7b12d02bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b00f11d8394be995ee987ac4f9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:36:59 user nova-compute[75634]: INFO nova.virt.block_device [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Booting with volume d1688aff-0b69-4d67-85ac-a78bb49f11a0 at /dev/vda
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Instance network_info: |[{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.neutron [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing network info cache for port 1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Start _get_guest_xml network_info=[{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:36:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'pci_devices' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG os_brick.utils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:36:59 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjtf4wne0/privsep.sock']
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:36:59 user nova-compute[75634]:   <uuid>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</uuid>
Nov 15 18:36:59 user nova-compute[75634]:   <name>instance-00000007</name>
Nov 15 18:36:59 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:36:59 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:36:59 user nova-compute[75634]:   <metadata>
Nov 15 18:36:59 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:36:59 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:36:59</nova:creationTime>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:36:59 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:36:59 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:owner>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:36:59 user nova-compute[75634]:       </nova:owner>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:36:59 user nova-compute[75634]:       <nova:ports>
Nov 15 18:36:59 user nova-compute[75634]:         <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:36:59 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:36:59 user nova-compute[75634]:         </nova:port>
Nov 15 18:36:59 user nova-compute[75634]:       </nova:ports>
Nov 15 18:36:59 user nova-compute[75634]:     </nova:instance>
Nov 15 18:36:59 user nova-compute[75634]:   </metadata>
Nov 15 18:36:59 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:36:59 user nova-compute[75634]:     <system>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="serial">9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="uuid">9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:36:59 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:36:59 user nova-compute[75634]:     </system>
Nov 15 18:36:59 user nova-compute[75634]:   </sysinfo>
Nov 15 18:36:59 user nova-compute[75634]:   <os>
Nov 15 18:36:59 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:36:59 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:36:59 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:36:59 user nova-compute[75634]:   </os>
Nov 15 18:36:59 user nova-compute[75634]:   <features>
Nov 15 18:36:59 user nova-compute[75634]:     <acpi/>
Nov 15 18:36:59 user nova-compute[75634]:     <apic/>
Nov 15 18:36:59 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:36:59 user nova-compute[75634]:   </features>
Nov 15 18:36:59 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:36:59 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:36:59 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:36:59 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:36:59 user nova-compute[75634]:   </clock>
Nov 15 18:36:59 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:36:59 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:36:59 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:36:59 user nova-compute[75634]:   </cpu>
Nov 15 18:36:59 user nova-compute[75634]:   <devices>
Nov 15 18:36:59 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:36:59 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:36:59 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk"/>
Nov 15 18:36:59 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:36:59 user nova-compute[75634]:     </disk>
Nov 15 18:36:59 user nova-compute[75634]:     <disk type="file" device="cdrom">
Nov 15 18:36:59 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 18:36:59 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config"/>
Nov 15 18:36:59 user nova-compute[75634]:       <target dev="hda" bus="ide"/>
Nov 15 18:36:59 user nova-compute[75634]:     </disk>
Nov 15 18:36:59 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:36:59 user nova-compute[75634]:       <mac address="fa:16:3e:28:4f:cf"/>
Nov 15 18:36:59 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:59 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:36:59 user nova-compute[75634]:       <target dev="tap1d52672f-2f"/>
Nov 15 18:36:59 user nova-compute[75634]:     </interface>
Nov 15 18:36:59 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:36:59 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log" append="off"/>
Nov 15 18:36:59 user nova-compute[75634]:     </serial>
Nov 15 18:36:59 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:36:59 user nova-compute[75634]:     <video>
Nov 15 18:36:59 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:36:59 user nova-compute[75634]:     </video>
Nov 15 18:36:59 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:36:59 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:36:59 user nova-compute[75634]:     </rng>
Nov 15 18:36:59 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:36:59 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:36:59 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:36:59 user nova-compute[75634]:     </memballoon>
Nov 15 18:36:59 user nova-compute[75634]:   </devices>
Nov 15 18:36:59 user nova-compute[75634]: </domain>
Nov 15 18:36:59 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG os_vif [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3427e2-c525-5e7e-9998-8dfda06ae982', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d52672f-2f, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d52672f-2f, col_values=(('qos', UUID('2189527b-ad4f-43b0-a4bf-9eeba3698cb9')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d52672f-2f, col_values=(('external_ids', {'iface-id': '1d52672f-2f92-4487-b730-82d4a60db5fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:4f:cf', 'vm-uuid': '9eb05a7b-5f61-4c36-b751-3ba2f1f857b8'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:36:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:36:59 user sudo[85886]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjtf4wne0/privsep.sock
Nov 15 18:36:59 user nova-compute[75634]: INFO os_vif [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f')
Nov 15 18:36:59 user sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name hda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No VIF found with MAC fa:16:3e:28:4f:cf, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Using config drive
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.192s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:37:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Successfully created port: 5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:37:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Creating image(s)
Nov 15 18:37:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "/opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "/opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "/opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:00 user nova-compute[75634]: DEBUG nova.policy [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2646dfa956b0401283a0e2585d9152b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3231a5e1864c969836a94a3bead96d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.429s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Successfully updated port: 5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-changed-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Refreshing instance network info cache due to event network-changed-5d3caf5f-9f37-4a79-abe5-c26c67dc074c. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] Acquiring lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] Acquired lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.network.neutron [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Refreshing network info cache for port 5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.319s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.network.neutron [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk 1073741824" returned: 0 in 0.081s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:37:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user sudo[85886]: pam_unix(sudo:session): session closed for user root
Nov 15 18:37:02 user nova-compute[75634]: INFO oslo.privsep.daemon [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Spawned new privsep daemon via rootwrap
Nov 15 18:37:02 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 18:37:02 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 18:37:02 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 18:37:02 user nova-compute[75634]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85900
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.465s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Cannot resize image /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Ensure instance console log exists: /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Successfully created port: dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a469d26-69b2-46de-aa6d-0fcdfa924c5f]: (2,) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83b6cb2e-292f-49b3-bdf8-4bfd591ffe6d req-66eefe69-6303-4526-b5af-89b6557d3bb6 service nova] Releasing lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquired lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updated VIF entry in instance network info cache for port 1d52672f-2f92-4487-b730-82d4a60db5fc. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cf69503-ca45-469a-a212-a10fd50f32a7 req-cf18af03-d9c9-45f8-a4d5-cec6c1d5b26d service nova] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:02 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Creating config drive at /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppxbrd7hh {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f988a3-d172-4a2b-a7ff-2300144e84b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: WARNING os_brick.initiator.connectors.nvmeof [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppxbrd7hh" returned: 0 in 0.092s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8a467-d049-423d-9b61-a7d32b3534e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d4992-30e9-4857-8db7-c9a9bf770368]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96807f59-a933-42a7-9d99-254e938bd6ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:02 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:37:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777a24f-5b26-4edc-b25a-7ed6f3e20009]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG os_brick.utils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== get_connector_properties: return (3107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:02 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating existing volume attachment record: 56460f83-c686-4fb7-84b8-83fa4966f98c {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Successfully updated port: d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquired lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-changed-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Refreshing instance network info cache due to event network-changed-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] Acquiring lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Successfully updated port: dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquired lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating instance_info_cache with network_info: [{"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Releasing lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance network_info: |[{"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-changed-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Refreshing instance network info cache due to event network-changed-dcc177e0-f225-4479-a6d0-0ba2c388b070. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] Acquiring lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updating instance_info_cache with network_info: [{"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Releasing lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Instance network_info: |[{"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] Acquired lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Refreshing network info cache for port dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Start _get_guest_xml network_info=[{"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:37:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:37:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1766858696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1766858696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1766858696',id=10,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/1aaZqlYfAeQVVJTYZuoTci4rFKdK6bNjUIrgclgjuDdw3n9bye1M/9RNYzadXUqzKvt1e9sNAZy7zLIuYev7rJTevJiVri5vnsFvUUwQBWoUHHQVf2wR8lyGzfYMi2w==',key_name='tempest-keypair-1912778318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa3231a5e1864c969836a94a3bead96d',ramdisk_id='',reservation_id='r-q802yzmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1755173631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1755173631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2646dfa956b0401283a0e2585d9152b9',uuid=dca2e952-fba6-40b7-8952-5524606cebaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converting VIF {"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lazy-loading 'pci_devices' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.neutron [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updating instance_info_cache with network_info: [{"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:37:04 user nova-compute[75634]:   <uuid>dca2e952-fba6-40b7-8952-5524606cebaf</uuid>
Nov 15 18:37:04 user nova-compute[75634]:   <name>instance-0000000a</name>
Nov 15 18:37:04 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:37:04 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:37:04 user nova-compute[75634]:   <metadata>
Nov 15 18:37:04 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:37:04 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1766858696</nova:name>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:37:03</nova:creationTime>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:37:04 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:owner>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:user uuid="2646dfa956b0401283a0e2585d9152b9">tempest-VolumesAssistedSnapshotsTest-1755173631-project-member</nova:user>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:project uuid="fa3231a5e1864c969836a94a3bead96d">tempest-VolumesAssistedSnapshotsTest-1755173631</nova:project>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:owner>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:ports>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:port uuid="dcc177e0-f225-4479-a6d0-0ba2c388b070">
Nov 15 18:37:04 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:37:04 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:ports>
Nov 15 18:37:04 user nova-compute[75634]:     </nova:instance>
Nov 15 18:37:04 user nova-compute[75634]:   </metadata>
Nov 15 18:37:04 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:37:04 user nova-compute[75634]:     <system>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="serial">dca2e952-fba6-40b7-8952-5524606cebaf</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="uuid">dca2e952-fba6-40b7-8952-5524606cebaf</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:37:04 user nova-compute[75634]:     </system>
Nov 15 18:37:04 user nova-compute[75634]:   </sysinfo>
Nov 15 18:37:04 user nova-compute[75634]:   <os>
Nov 15 18:37:04 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:37:04 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:37:04 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:37:04 user nova-compute[75634]:   </os>
Nov 15 18:37:04 user nova-compute[75634]:   <features>
Nov 15 18:37:04 user nova-compute[75634]:     <acpi/>
Nov 15 18:37:04 user nova-compute[75634]:     <apic/>
Nov 15 18:37:04 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:37:04 user nova-compute[75634]:   </features>
Nov 15 18:37:04 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:37:04 user nova-compute[75634]:   </clock>
Nov 15 18:37:04 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:37:04 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:37:04 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:37:04 user nova-compute[75634]:   </cpu>
Nov 15 18:37:04 user nova-compute[75634]:   <devices>
Nov 15 18:37:04 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:37:04 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:37:04 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk"/>
Nov 15 18:37:04 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:37:04 user nova-compute[75634]:     </disk>
Nov 15 18:37:04 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:04 user nova-compute[75634]:       <mac address="fa:16:3e:15:20:69"/>
Nov 15 18:37:04 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:04 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:04 user nova-compute[75634]:       <target dev="tapdcc177e0-f2"/>
Nov 15 18:37:04 user nova-compute[75634]:     </interface>
Nov 15 18:37:04 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:37:04 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/console.log" append="off"/>
Nov 15 18:37:04 user nova-compute[75634]:     </serial>
Nov 15 18:37:04 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:37:04 user nova-compute[75634]:     <video>
Nov 15 18:37:04 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:04 user nova-compute[75634]:     </video>
Nov 15 18:37:04 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:37:04 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:37:04 user nova-compute[75634]:     </rng>
Nov 15 18:37:04 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:37:04 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:37:04 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:37:04 user nova-compute[75634]:     </memballoon>
Nov 15 18:37:04 user nova-compute[75634]:   </devices>
Nov 15 18:37:04 user nova-compute[75634]: </domain>
Nov 15 18:37:04 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1766858696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1766858696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1766858696',id=10,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/1aaZqlYfAeQVVJTYZuoTci4rFKdK6bNjUIrgclgjuDdw3n9bye1M/9RNYzadXUqzKvt1e9sNAZy7zLIuYev7rJTevJiVri5vnsFvUUwQBWoUHHQVf2wR8lyGzfYMi2w==',key_name='tempest-keypair-1912778318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa3231a5e1864c969836a94a3bead96d',ramdisk_id='',reservation_id='r-q802yzmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1755173631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1755173631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2646dfa956b0401283a0e2585d9152b9',uuid=dca2e952-fba6-40b7-8952-5524606cebaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converting VIF {"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG os_vif [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Releasing lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Instance network_info: |[{"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] Acquired lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.neutron [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Refreshing network info cache for port d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Start _get_guest_xml network_info=[{"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:36:43Z,direct_url=<?>,disk_format='qcow2',id=fcb6c264-52bf-42bc-8eaf-01300f6d70c2,min_disk=0,min_ram=0,name='',owner='88f3f415699a4defb8932046e7820415',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:36:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'image_id': 'fcb6c264-52bf-42bc-8eaf-01300f6d70c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2a7ae1c-17e4-52cb-9c30-81a725abf495', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc177e0-f2, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc177e0-f2, col_values=(('qos', UUID('12f285a4-9d4e-4bad-9d57-175f07dbf98e')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc177e0-f2, col_values=(('external_ids', {'iface-id': 'dcc177e0-f225-4479-a6d0-0ba2c388b070', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:20:69', 'vm-uuid': 'dca2e952-fba6-40b7-8952-5524606cebaf'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:04 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:04 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: INFO os_vif [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2')
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:36:43Z,direct_url=<?>,disk_format='qcow2',id=fcb6c264-52bf-42bc-8eaf-01300f6d70c2,min_disk=0,min_ram=0,name='',owner='88f3f415699a4defb8932046e7820415',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:36:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1372928701',display_name='tempest-AttachSCSIVolumeTestJSON-server-1372928701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1372928701',id=8,image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAgDfLZ7BR2H8VmF/vECfuTgLODE3eLfGXfTWTs4yq4/gsQqN5AM3VrCeLRH3A4Fk9wJV9g5bObkf+ZIPxcDjj4KTBjNt9nETd25M2io1Ve/CBS+UWRtO4ObzjCQKUpIQ==',key_name='tempest-keypair-342561368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90fa379a4301426998176df23feda180',ramdisk_id='',reservation_id='r-fhppxnuf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1982087370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1982087370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e1a64114ef94c81b3592a30d8418aa1',uuid=db30cd06-6f39-4ee8-b229-cfa071a0ef88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converting VIF {"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lazy-loading 'pci_devices' on Instance uuid db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:37:04 user nova-compute[75634]:   <uuid>db30cd06-6f39-4ee8-b229-cfa071a0ef88</uuid>
Nov 15 18:37:04 user nova-compute[75634]:   <name>instance-00000008</name>
Nov 15 18:37:04 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:37:04 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:37:04 user nova-compute[75634]:   <metadata>
Nov 15 18:37:04 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:37:04 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1372928701</nova:name>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:37:04</nova:creationTime>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:37:04 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:owner>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:user uuid="2e1a64114ef94c81b3592a30d8418aa1">tempest-AttachSCSIVolumeTestJSON-1982087370-project-member</nova:user>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:project uuid="90fa379a4301426998176df23feda180">tempest-AttachSCSIVolumeTestJSON-1982087370</nova:project>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:owner>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:root type="image" uuid="fcb6c264-52bf-42bc-8eaf-01300f6d70c2"/>
Nov 15 18:37:04 user nova-compute[75634]:       <nova:ports>
Nov 15 18:37:04 user nova-compute[75634]:         <nova:port uuid="d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939">
Nov 15 18:37:04 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 18:37:04 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:04 user nova-compute[75634]:       </nova:ports>
Nov 15 18:37:04 user nova-compute[75634]:     </nova:instance>
Nov 15 18:37:04 user nova-compute[75634]:   </metadata>
Nov 15 18:37:04 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:37:04 user nova-compute[75634]:     <system>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="serial">db30cd06-6f39-4ee8-b229-cfa071a0ef88</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="uuid">db30cd06-6f39-4ee8-b229-cfa071a0ef88</entry>
Nov 15 18:37:04 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:37:04 user nova-compute[75634]:     </system>
Nov 15 18:37:04 user nova-compute[75634]:   </sysinfo>
Nov 15 18:37:04 user nova-compute[75634]:   <os>
Nov 15 18:37:04 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:37:04 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:37:04 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:37:04 user nova-compute[75634]:   </os>
Nov 15 18:37:04 user nova-compute[75634]:   <features>
Nov 15 18:37:04 user nova-compute[75634]:     <acpi/>
Nov 15 18:37:04 user nova-compute[75634]:     <apic/>
Nov 15 18:37:04 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:37:04 user nova-compute[75634]:   </features>
Nov 15 18:37:04 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:37:04 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:37:04 user nova-compute[75634]:   </clock>
Nov 15 18:37:04 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:37:04 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:37:04 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:37:04 user nova-compute[75634]:   </cpu>
Nov 15 18:37:04 user nova-compute[75634]:   <devices>
Nov 15 18:37:04 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:37:04 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:37:04 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk"/>
Nov 15 18:37:04 user nova-compute[75634]:       <target dev="sda" bus="scsi"/>
Nov 15 18:37:04 user nova-compute[75634]:       <address type="drive" controller="0" unit="0"/>
Nov 15 18:37:04 user nova-compute[75634]:     </disk>
Nov 15 18:37:04 user nova-compute[75634]:     <disk type="file" device="cdrom">
Nov 15 18:37:04 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 18:37:04 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.config"/>
Nov 15 18:37:04 user nova-compute[75634]:       <target dev="sdb" bus="scsi"/>
Nov 15 18:37:04 user nova-compute[75634]:       <address type="drive" controller="0" unit="1"/>
Nov 15 18:37:04 user nova-compute[75634]:     </disk>
Nov 15 18:37:04 user nova-compute[75634]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 18:37:04 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:04 user nova-compute[75634]:       <mac address="fa:16:3e:7b:80:82"/>
Nov 15 18:37:04 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:04 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:04 user nova-compute[75634]:       <target dev="tapd5afcc93-c4"/>
Nov 15 18:37:04 user nova-compute[75634]:     </interface>
Nov 15 18:37:04 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:37:04 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/console.log" append="off"/>
Nov 15 18:37:04 user nova-compute[75634]:     </serial>
Nov 15 18:37:04 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:37:04 user nova-compute[75634]:     <video>
Nov 15 18:37:04 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:04 user nova-compute[75634]:     </video>
Nov 15 18:37:04 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:37:04 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:37:04 user nova-compute[75634]:     </rng>
Nov 15 18:37:04 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:37:04 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:37:04 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:37:04 user nova-compute[75634]:     </memballoon>
Nov 15 18:37:04 user nova-compute[75634]:   </devices>
Nov 15 18:37:04 user nova-compute[75634]: </domain>
Nov 15 18:37:04 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1372928701',display_name='tempest-AttachSCSIVolumeTestJSON-server-1372928701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1372928701',id=8,image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAgDfLZ7BR2H8VmF/vECfuTgLODE3eLfGXfTWTs4yq4/gsQqN5AM3VrCeLRH3A4Fk9wJV9g5bObkf+ZIPxcDjj4KTBjNt9nETd25M2io1Ve/CBS+UWRtO4ObzjCQKUpIQ==',key_name='tempest-keypair-342561368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90fa379a4301426998176df23feda180',ramdisk_id='',reservation_id='r-fhppxnuf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1982087370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1982087370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e1a64114ef94c81b3592a30d8418aa1',uuid=db30cd06-6f39-4ee8-b229-cfa071a0ef88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converting VIF {"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG os_vif [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4243496e-78b2-5552-9072-97cf16a5eac1', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5afcc93-c4, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5afcc93-c4, col_values=(('qos', UUID('2573ddd8-5d6c-41bd-938e-5217fe6d78b9')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5afcc93-c4, col_values=(('external_ids', {'iface-id': 'd5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:80:82', 'vm-uuid': 'db30cd06-6f39-4ee8-b229-cfa071a0ef88'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] No VIF found with MAC fa:16:3e:15:20:69, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:04 user nova-compute[75634]: INFO os_vif [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4')
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No BDM found with device name sda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No VIF found with MAC fa:16:3e:7b:80:82, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Using config drive
Nov 15 18:37:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Creating config drive at /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.config
Nov 15 18:37:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx8oab3b8 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updated VIF entry in instance network info cache for port dcc177e0-f225-4479-a6d0-0ba2c388b070. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updating instance_info_cache with network_info: [{"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx8oab3b8" returned: 0 in 0.091s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-af004b0b-5075-46cd-8102-dffdb506f683 req-67747747-57ae-4630-ad08-275309fc4fff service nova] Releasing lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updated VIF entry in instance network info cache for port d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updating instance_info_cache with network_info: [{"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ae961ed2-17c7-4e19-ac95-7a37f1bcdb3f req-79d0ad41-50e0-49be-b42b-5c42171af96e service nova] Releasing lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:37:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Instance spawned successfully.
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:09 user nova-compute[75634]: INFO nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Took 16.58 seconds to spawn the instance on the hypervisor.
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:09 user nova-compute[75634]: INFO nova.compute.manager [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Took 18.00 seconds to build instance.
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2b41a089-09fd-4a42-870f-980946cfa64c tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.296s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:37:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Creating image(s)
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Ensure instance console log exists: /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start _get_guest_xml network_info=[{"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65848bf6-8074-4bab-804c-342f3edcc0cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1688aff-0b69-4d67-85ac-a78bb49f11a0', 'serial': 'd1688aff-0b69-4d67-85ac-a78bb49f11a0'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '56460f83-c686-4fb7-84b8-83fa4966f98c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:37:09 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:09 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connector [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Factory for ISCSI on None {{(pid=75634) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:09 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:09 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:09 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe429a57-500a-4694-b12a-69f7a7c21633]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:37:09 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c44a3e5-5feb-49d6-b0ce-401c600bb73f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0] added
Nov 15 18:37:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[399f7c7f-0f99-4e3d-a950-e4ff045e1598]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c06e5f-adb6-41ed-9087-6321e838edc5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwUvDiFj {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwUvDiFj" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c1a3c2-2e6d-47a1-a9a9-e2a97558c38e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwUvDiFj'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[176013ef-bbdf-400e-b499-1667bd4fab04]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8301fe-96af-4283-a59f-481c3dc45b6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 18:37:09 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 18:37:09 user nova-compute[75634]:  {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:09 user nova-compute[75634]: WARNING os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 18:37:09 user nova-compute[75634]: 
Nov 15 18:37:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b8dbd-68e3-46a7-a86f-02a8fb474a40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]
Nov 15 18:37:10 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.
Nov 15 18:37:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833341e-b48b-4acd-b9b3-473a1d2fd451]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085964c-b657-4724-b291-35ec2ec3f9eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b3a365-88ec-45eb-8bc3-97fc562c186a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Instance spawned successfully.
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Instance spawned successfully.
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Took 9.73 seconds to spawn the instance on the hypervisor.
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Took 15.25 seconds to spawn the instance on the hypervisor.
Nov 15 18:37:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.compute.manager [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Took 12.37 seconds to build instance.
Nov 15 18:37:10 user nova-compute[75634]: INFO nova.compute.manager [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Took 16.78 seconds to build instance.
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5d144f59-c2b7-4138-a397-c9c6a856de4b tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.717s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-72c99d04-760c-4540-ba47-a9574102ceb2 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.014s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23663323163623461', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663323163623461', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1071587773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.objects.instance [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lazy-loading 'pci_devices' on Instance uuid 65848bf6-8074-4bab-804c-342f3edcc0cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:37:11 user nova-compute[75634]:   <uuid>65848bf6-8074-4bab-804c-342f3edcc0cc</uuid>
Nov 15 18:37:11 user nova-compute[75634]:   <name>instance-00000009</name>
Nov 15 18:37:11 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:37:11 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:37:11 user nova-compute[75634]:   <metadata>
Nov 15 18:37:11 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:37:11 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:37:11 user nova-compute[75634]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1071587773</nova:name>
Nov 15 18:37:11 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:37:09</nova:creationTime>
Nov 15 18:37:11 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:37:11 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:37:11 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:37:11 user nova-compute[75634]:       <nova:owner>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:user uuid="1ddac01d950041a99517eed7b12d02bb">tempest-ServerActionsV293TestJSON-1306189062-project-member</nova:user>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:project uuid="70b00f11d8394be995ee987ac4f9fbaf">tempest-ServerActionsV293TestJSON-1306189062</nova:project>
Nov 15 18:37:11 user nova-compute[75634]:       </nova:owner>
Nov 15 18:37:11 user nova-compute[75634]:       <nova:ports>
Nov 15 18:37:11 user nova-compute[75634]:         <nova:port uuid="5d3caf5f-9f37-4a79-abe5-c26c67dc074c">
Nov 15 18:37:11 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:37:11 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:11 user nova-compute[75634]:       </nova:ports>
Nov 15 18:37:11 user nova-compute[75634]:     </nova:instance>
Nov 15 18:37:11 user nova-compute[75634]:   </metadata>
Nov 15 18:37:11 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:37:11 user nova-compute[75634]:     <system>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="serial">65848bf6-8074-4bab-804c-342f3edcc0cc</entry>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="uuid">65848bf6-8074-4bab-804c-342f3edcc0cc</entry>
Nov 15 18:37:11 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:37:11 user nova-compute[75634]:     </system>
Nov 15 18:37:11 user nova-compute[75634]:   </sysinfo>
Nov 15 18:37:11 user nova-compute[75634]:   <os>
Nov 15 18:37:11 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:37:11 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:37:11 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:37:11 user nova-compute[75634]:   </os>
Nov 15 18:37:11 user nova-compute[75634]:   <features>
Nov 15 18:37:11 user nova-compute[75634]:     <acpi/>
Nov 15 18:37:11 user nova-compute[75634]:     <apic/>
Nov 15 18:37:11 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:37:11 user nova-compute[75634]:   </features>
Nov 15 18:37:11 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:37:11 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:37:11 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:37:11 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:37:11 user nova-compute[75634]:   </clock>
Nov 15 18:37:11 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:37:11 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:37:11 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:37:11 user nova-compute[75634]:   </cpu>
Nov 15 18:37:11 user nova-compute[75634]:   <devices>
Nov 15 18:37:11 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:37:11 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:37:11 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 18:37:11 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:37:11 user nova-compute[75634]:       <serial>d1688aff-0b69-4d67-85ac-a78bb49f11a0</serial>
Nov 15 18:37:11 user nova-compute[75634]:     </disk>
Nov 15 18:37:11 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:11 user nova-compute[75634]:       <mac address="fa:16:3e:f5:32:32"/>
Nov 15 18:37:11 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:11 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:11 user nova-compute[75634]:       <target dev="tap5d3caf5f-9f"/>
Nov 15 18:37:11 user nova-compute[75634]:     </interface>
Nov 15 18:37:11 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:37:11 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc/console.log" append="off"/>
Nov 15 18:37:11 user nova-compute[75634]:     </serial>
Nov 15 18:37:11 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:37:11 user nova-compute[75634]:     <video>
Nov 15 18:37:11 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:11 user nova-compute[75634]:     </video>
Nov 15 18:37:11 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:37:11 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:37:11 user nova-compute[75634]:     </rng>
Nov 15 18:37:11 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:37:11 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:37:11 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:37:11 user nova-compute[75634]:     </memballoon>
Nov 15 18:37:11 user nova-compute[75634]:   </devices>
Nov 15 18:37:11 user nova-compute[75634]: </domain>
Nov 15 18:37:11 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1071587773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG os_vif [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e29899cc-8d45-5380-96d7-7ef6acdf7ab4', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d3caf5f-9f, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d3caf5f-9f, col_values=(('qos', UUID('8e1d0bc7-1d0e-4ed2-ad64-374f075bc67c')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d3caf5f-9f, col_values=(('external_ids', {'iface-id': '5d3caf5f-9f37-4a79-abe5-c26c67dc074c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:32:32', 'vm-uuid': '65848bf6-8074-4bab-804c-342f3edcc0cc'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:11 user nova-compute[75634]: INFO os_vif [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f')
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] No VIF found with MAC fa:16:3e:f5:32:32, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:11 user nova-compute[75634]: WARNING nova.compute.manager [req-f9823f28-4d54-44a6-9538-41d286b8106b req-6e24607a-3545-4f08-b760-f95b1f06366f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state None.
Nov 15 18:37:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:13 user nova-compute[75634]: WARNING nova.compute.manager [req-3f20ad9b-10c5-4a31-9398-7d36ce31db4c req-98405609-2471-47c3-a023-29127c3f4c41 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state building and task_state spawning.
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:13 user nova-compute[75634]: WARNING nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state None.
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] No waiting events found dispatching network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:13 user nova-compute[75634]: WARNING nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received unexpected event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 for instance with vm_state active and task_state None.
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] No waiting events found dispatching network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:13 user nova-compute[75634]: WARNING nova.compute.manager [req-74a06227-bcc9-4c89-b89e-fb7e03f2033b req-d21c4a66-a5f4-447d-8fe0-982f475291c9 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received unexpected event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 for instance with vm_state active and task_state None.
Nov 15 18:37:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Skipping network cache update for instance because it is Building. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:37:15 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance spawned successfully.
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:15 user nova-compute[75634]: INFO nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:15 user nova-compute[75634]: WARNING nova.compute.manager [req-127bf7e6-328a-4d21-b48c-9e8d6f48c550 req-edd42c4c-76ea-422f-bab2-04732b54a273 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state building and task_state spawning.
Nov 15 18:37:15 user nova-compute[75634]: INFO nova.compute.manager [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Took 18.06 seconds to build instance.
Nov 15 18:37:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-feb19612-81e0-4289-9ffa-f03da94b0ce5 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.515s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updating instance_info_cache with network_info: [{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:16 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:37:16 user nova-compute[75634]: INFO nova.compute.claims [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Claim successful on node user
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:37:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:37:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:17 user nova-compute[75634]: INFO nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Booting with volume a8cf6fe1-b728-4d7a-b3d8-85f429865b0d at /dev/vda
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG nova.policy [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c472d7cb7dc4ea2bf629f476397df98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5692c579c294988b628dd2c27fbc303', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67f87f-5e16-4b1c-bdb5-603a8a8de021]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c993b-c193-49ff-ab6b-5f3248380d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1866af1-6339-4b63-8ede-370312fd3c56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d285133-d52c-437a-949f-7e99a7b9a6d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:18 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1aa1b9-107b-4e13-81a2-2d8a386cd7db]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating existing volume attachment record: 5cf14216-e21c-4b11-92a7-4128907e219a {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully created port: a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully created port: fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:37:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully created port: fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.56243133544922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully created port: 8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 65848bf6-8074-4bab-804c-342f3edcc0cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dca2e952-fba6-40b7-8952-5524606cebaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 47112be8-147d-4f27-853c-d306ae4bfe19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 18:37:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully created port: a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.259s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG nova.network.neutron [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5bbe0478-67ac-4790-995d-eb8997666705 req-c161f909-0dc7-4a25-9408-4f16c779e4f9 service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:37:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: 0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:25 user nova-compute[75634]: INFO nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Booting with volume 873c57e5-2aae-45a1-bb08-86e58c66cc55 at /dev/vdb
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bc3169-2a2e-4db0-8a37-916d4a42ea27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba31638c-f98a-4a41-8262-0c8f8c71200b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a614c30d-f3e5-4610-a2a3-ac3793f66061]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf29581-97fb-43c3-9aab-cff6c2e5104f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: 0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:25 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d071f7-bd6c-49d0-9584-010af7aa8b8c]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating existing volume attachment record: 24ff93d4-fbfa-4dd8-89c6-77425611ef69 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-0cf38851-4aaf-472d-bca7-039d3c78eb05. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port 0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-0417467e-87d7-42e9-be85-1de345e580b7. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port 0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f6e36b3-64d4-40d3-b634-8866628b19f6 req-0d3f7177-a5e8-459f-bb3b-e605c0c2fed9 service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-fac230d3-6259-46c2-ad96-d62bc5ee2a50. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: 8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:27 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-fcf97f8b-6858-4ae5-acc1-bc41ffee7126. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-119c08a9-79fd-4e76-ac94-7572813aa3d3 req-73954d5a-83b4-404f-aede-6fe028fac98d service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Successfully updated port: a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:37:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:37:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-8d6682b8-f366-4f2c-99ff-83c006b8c4e8. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance network_info: |[{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port 8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updated VIF entry in instance network info cache for port 8d6682b8-f366-4f2c-99ff-83c006b8c4e8. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-a2fce040-a3de-4ae6-81a1-8e930e645afe. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:37:31 user nova-compute[75634]: INFO nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Booting with volume 8f8905ff-295f-4f74-8824-8da2aba13e09 at /dev/vdc
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07482ee-3a6a-4c55-bd10-384971555cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac4dd8-e79a-4672-9664-befb554efd69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61627cf-5572-4ca5-9483-91c8660a869b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b879afa-5c59-45a1-9060-cda24625c3cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:37:31 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:37:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd76a06-fea9-471a-a85b-f643e444e464]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:31 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating existing volume attachment record: 14b2f432-6e74-4491-84ca-9d828175302a {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received event network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] No waiting events found dispatching network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:32 user nova-compute[75634]: WARNING nova.compute.manager [req-101a2311-8b11-4b2f-b5aa-24e7cd6e7068 req-2ec9b4ab-5de3-4044-b527-560ac0d84ec5 service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received unexpected event network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf for instance with vm_state active and task_state None.
Nov 15 18:37:32 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updated VIF entry in instance network info cache for port a2fce040-a3de-4ae6-81a1-8e930e645afe. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG nova.network.neutron [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:37:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3c6a04a-74af-4d58-8fbf-edceedeb7cb8 req-8cbf96aa-baa8-4329-b5df-2167f772e8be service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received event network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] No waiting events found dispatching network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received unexpected event network-vif-plugged-89b9a43a-f31f-484e-9f87-2e18abbf17cf for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] No waiting events found dispatching network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received unexpected event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] No waiting events found dispatching network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received unexpected event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] No waiting events found dispatching network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received unexpected event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 for instance with vm_state active and task_state None.
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] No waiting events found dispatching network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:34 user nova-compute[75634]: WARNING nova.compute.manager [req-634a0e64-eb44-4d4a-a7d7-408a4193b22e req-2d1111c6-a1a6-4857-b513-8c6ebdeeef2b service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received unexpected event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 for instance with vm_state active and task_state None.
Nov 15 18:37:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:37:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Creating image(s)
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Ensure instance console log exists: /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Start _get_guest_xml network_info=[{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTNutOcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47112be8-147d-4f27-853c-d306ae4bfe19', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 'serial': 'a8cf6fe1-b728-4d7a-b3d8-85f429865b0d'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '5cf14216-e21c-4b11-92a7-4128907e219a', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGQaoUhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47112be8-147d-4f27-853c-d306ae4bfe19', 'attached_at': '', 'detached_at': '', 'volume_id': '873c57e5-2aae-45a1-bb08-86e58c66cc55', 'serial': '873c57e5-2aae-45a1-bb08-86e58c66cc55'}, 'guest_format': None, 'boot_index': 1, 'attachment_id': '24ff93d4-fbfa-4dd8-89c6-77425611ef69', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AikfSWIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47112be8-147d-4f27-853c-d306ae4bfe19', 'attached_at': '', 'detached_at': '', 'volume_id': '8f8905ff-295f-4f74-8824-8da2aba13e09', 'serial': '8f8905ff-295f-4f74-8824-8da2aba13e09'}, 'guest_format': None, 'boot_index': 2, 'attachment_id': '14b2f432-6e74-4491-84ca-9d828175302a', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:37:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTNutOcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:36 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[430246d9-a075-471b-9322-2803eb0c0e9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:37:36 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[271adf1b-02a3-4d0a-a186-fab09bc2e2fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d] added
Nov 15 18:37:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5deb477-7a18-4ef3-9f46-78dde01110a3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c62178-9f60-4912-9f8a-1393bb418732]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTNutOcF {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTNutOcF" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4712105e-515a-42df-9a23-96eeb68dab22]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTNutOcF'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec01a90-42da-4e40-966b-b32481878197]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f1ebc-d5d4-45df-bef2-fb0da9708769]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd5f94-1aee-4627-985b-b85b03876dae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260]
Nov 15 18:37:37 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260] successful.
Nov 15 18:37:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7c6b0f-1602-463c-85c2-b5eece85dc72]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be222e08-6421-4afc-bec8-4ffbe093c88d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:37 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:37 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d890053b-a4d0-495e-ad98-b0ef7517405f]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTNutOcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23532313538316339', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532313538316339', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGQaoUhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:38 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[239d0ea6-a6f8-4d3a-9a66-025a1c0330d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:37:38 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b8f48-2c2a-4e3f-af25-dc94dd0bc9d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55] added
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ed3759-822d-4ead-8198-23f7d682329c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e96e4-6fb2-4b3d-931b-31f2f39cd3c5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGQaoUhD {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGQaoUhD" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d61ac3-46a3-4de5-af3f-f8da83270e40]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kGQaoUhD'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce0b5f5-35e6-4bab-b3da-97e121359092]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d2f374-36c5-43ab-ba09-4e43345abc24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[545d5338-e72c-416d-97c8-7f778ab659f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260]
Nov 15 18:37:38 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260] successful.
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527d57d-69d5-482a-9e9a-7a368348c3ab]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40c6b25-6072-44e1-a072-9b71f79074bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:38 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08555bc-3953-4beb-a42a-87af1f27b0da]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:37:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGQaoUhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26430353631356162', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430353631356162', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AikfSWIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:37:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:37:39 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a9e648-42c5-4ce7-9058-c7a708cccb71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:37:39 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e139bd-4d95-4241-ad16-a5af7bc6b947]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09] added
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8dbb68-4996-49aa-a7b3-f8b932d30e7f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce63d74a-0271-4f04-97f2-7eff1fe73153]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AikfSWIm {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AikfSWIm" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7dcc30-6ffd-46de-a62b-ce6e58f18f5c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AikfSWIm'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[320bd5df-82f2-4e8d-9dba-05a2a922cc70]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7563699-6cfc-42d0-8726-29ba75768561]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b808da8-930b-4eae-9850-7649ebd82df3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260]
Nov 15 18:37:39 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260] successful.
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0f8cf-5717-489c-ab14-a8c3f3efc0a5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e808be-a3a7-436b-90c0-4632e783809e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:37:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[79086061-76c8-4c5c-abfc-2bee01a6a446]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:37:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AikfSWIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23436656436313133', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436656436313133', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lazy-loading 'pci_devices' on Instance uuid 47112be8-147d-4f27-853c-d306ae4bfe19 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:37:40 user nova-compute[75634]:   <uuid>47112be8-147d-4f27-853c-d306ae4bfe19</uuid>
Nov 15 18:37:40 user nova-compute[75634]:   <name>instance-0000000b</name>
Nov 15 18:37:40 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:37:40 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:37:40 user nova-compute[75634]:   <metadata>
Nov 15 18:37:40 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:37:40 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:name>tempest-device-tagging-server-1507602507</nova:name>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:37:36</nova:creationTime>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:37:40 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:37:40 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:owner>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:user uuid="7c472d7cb7dc4ea2bf629f476397df98">tempest-TaggedBootDevicesTest_v242-793619391-project-member</nova:user>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:project uuid="c5692c579c294988b628dd2c27fbc303">tempest-TaggedBootDevicesTest_v242-793619391</nova:project>
Nov 15 18:37:40 user nova-compute[75634]:       </nova:owner>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:37:40 user nova-compute[75634]:       <nova:ports>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="a87933ae-11a4-4393-8eb2-2fe2f6d6aef3">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="0cf38851-4aaf-472d-bca7-039d3c78eb05">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.20" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="0417467e-87d7-42e9-be85-1de345e580b7">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.200" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="fac230d3-6259-46c2-ad96-d62bc5ee2a50">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="fcf97f8b-6858-4ae5-acc1-bc41ffee7126">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="8d6682b8-f366-4f2c-99ff-83c006b8c4e8">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:         <nova:port uuid="a2fce040-a3de-4ae6-81a1-8e930e645afe">
Nov 15 18:37:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 18:37:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:37:40 user nova-compute[75634]:       </nova:ports>
Nov 15 18:37:40 user nova-compute[75634]:     </nova:instance>
Nov 15 18:37:40 user nova-compute[75634]:   </metadata>
Nov 15 18:37:40 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:37:40 user nova-compute[75634]:     <system>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="serial">47112be8-147d-4f27-853c-d306ae4bfe19</entry>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="uuid">47112be8-147d-4f27-853c-d306ae4bfe19</entry>
Nov 15 18:37:40 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:37:40 user nova-compute[75634]:     </system>
Nov 15 18:37:40 user nova-compute[75634]:   </sysinfo>
Nov 15 18:37:40 user nova-compute[75634]:   <os>
Nov 15 18:37:40 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:37:40 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:37:40 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:37:40 user nova-compute[75634]:   </os>
Nov 15 18:37:40 user nova-compute[75634]:   <features>
Nov 15 18:37:40 user nova-compute[75634]:     <acpi/>
Nov 15 18:37:40 user nova-compute[75634]:     <apic/>
Nov 15 18:37:40 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:37:40 user nova-compute[75634]:   </features>
Nov 15 18:37:40 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:37:40 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:37:40 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:37:40 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:37:40 user nova-compute[75634]:   </clock>
Nov 15 18:37:40 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:37:40 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:37:40 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:37:40 user nova-compute[75634]:   </cpu>
Nov 15 18:37:40 user nova-compute[75634]:   <devices>
Nov 15 18:37:40 user nova-compute[75634]:     <disk type="file" device="cdrom">
Nov 15 18:37:40 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 18:37:40 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/disk.config"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="hda" bus="ide"/>
Nov 15 18:37:40 user nova-compute[75634]:     </disk>
Nov 15 18:37:40 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:37:40 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:37:40 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <serial>a8cf6fe1-b728-4d7a-b3d8-85f429865b0d</serial>
Nov 15 18:37:40 user nova-compute[75634]:     </disk>
Nov 15 18:37:40 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:37:40 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:37:40 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <serial>873c57e5-2aae-45a1-bb08-86e58c66cc55</serial>
Nov 15 18:37:40 user nova-compute[75634]:     </disk>
Nov 15 18:37:40 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:37:40 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:37:40 user nova-compute[75634]:       <source dev="/dev/sde"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="vdc" bus="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <serial>8f8905ff-295f-4f74-8824-8da2aba13e09</serial>
Nov 15 18:37:40 user nova-compute[75634]:     </disk>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:bf:cc:ba"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tapa87933ae-11"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:63:9f:bf"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tap0cf38851-4a"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:27:4c:5a"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tap0417467e-87"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:42:c0:a6"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tapfac230d3-62"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:8e:0f:5d"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tapfcf97f8b-68"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:97:b2:af"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tap8d6682b8-f3"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:37:40 user nova-compute[75634]:       <mac address="fa:16:3e:15:2a:98"/>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:37:40 user nova-compute[75634]:       <target dev="tapa2fce040-a3"/>
Nov 15 18:37:40 user nova-compute[75634]:     </interface>
Nov 15 18:37:40 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:37:40 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/console.log" append="off"/>
Nov 15 18:37:40 user nova-compute[75634]:     </serial>
Nov 15 18:37:40 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:37:40 user nova-compute[75634]:     <video>
Nov 15 18:37:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:37:40 user nova-compute[75634]:     </video>
Nov 15 18:37:40 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:37:40 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:37:40 user nova-compute[75634]:     </rng>
Nov 15 18:37:40 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:37:40 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:37:40 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:37:40 user nova-compute[75634]:     </memballoon>
Nov 15 18:37:40 user nova-compute[75634]:   </devices>
Nov 15 18:37:40 user nova-compute[75634]: </domain>
Nov 15 18:37:40 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13226ead-3b1c-5eab-801e-520496acd5c2', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa87933ae-11, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa87933ae-11, col_values=(('qos', UUID('a63322af-e5b9-4d15-a5c4-e66fcefd33c4')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa87933ae-11, col_values=(('external_ids', {'iface-id': 'a87933ae-11a4-4393-8eb2-2fe2f6d6aef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:cc:ba', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24d175aa-dc7f-5998-8c0a-e5079f078972', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cf38851-4a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cf38851-4a, col_values=(('qos', UUID('0a87369f-20ae-43df-b087-24b07f4401dd')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cf38851-4a, col_values=(('external_ids', {'iface-id': '0cf38851-4aaf-472d-bca7-039d3c78eb05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9f:bf', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebb52a08-bb0f-592c-9096-e0f0fea231eb', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0417467e-87, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0417467e-87, col_values=(('qos', UUID('263966a8-eb4f-4281-90b5-702d3a59d135')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0417467e-87, col_values=(('external_ids', {'iface-id': '0417467e-87d7-42e9-be85-1de345e580b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:4c:5a', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83ab196d-81f2-534d-96c5-3e5a25e6f6ca', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac230d3-62, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac230d3-62, col_values=(('qos', UUID('c6a5249a-479b-4abb-a10f-72f1ce987b21')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac230d3-62, col_values=(('external_ids', {'iface-id': 'fac230d3-6259-46c2-ad96-d62bc5ee2a50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:c0:a6', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f22b605e-96ee-567d-8bcf-bc40709d30c1', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf97f8b-68, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf97f8b-68, col_values=(('qos', UUID('86442ec1-7d9f-40cd-9d33-5930bbb4972e')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf97f8b-68, col_values=(('external_ids', {'iface-id': 'fcf97f8b-6858-4ae5-acc1-bc41ffee7126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:0f:5d', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3ba5186-f346-5744-80fe-4391e65e0ab6', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d6682b8-f3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d6682b8-f3, col_values=(('qos', UUID('b6115a5b-28be-429a-a784-132aa5a582c7')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d6682b8-f3, col_values=(('external_ids', {'iface-id': '8d6682b8-f366-4f2c-99ff-83c006b8c4e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:b2:af', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d2d3c04-9f47-59ae-9a88-361ba76fc640', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2fce040-a3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2fce040-a3, col_values=(('qos', UUID('0985f846-76d6-42a7-8a03-f02098ff9dbe')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2fce040-a3, col_values=(('external_ids', {'iface-id': 'a2fce040-a3de-4ae6-81a1-8e930e645afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:2a:98', 'vm-uuid': '47112be8-147d-4f27-853c-d306ae4bfe19'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:41 user nova-compute[75634]: INFO os_vif [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3')
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] No BDM found with device name hda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] No VIF found with MAC fa:16:3e:bf:cc:ba, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] No VIF found with MAC fa:16:3e:8e:0f:5d, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:37:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Using config drive
Nov 15 18:37:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Creating config drive at /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/disk.config
Nov 15 18:37:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeo_am4gi {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:37:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeo_am4gi" returned: 0 in 0.053s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:43 user nova-compute[75634]: WARNING nova.compute.manager [req-befb34f9-067b-40f9-96d1-d581d6acbe9e req-c8cfa2ba-f85f-435a-9b8c-c45c93f30c92 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 for instance with vm_state building and task_state spawning.
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:44 user nova-compute[75634]: WARNING nova.compute.manager [req-89195588-7e51-4034-a04f-f74e8b270ceb req-75bddb41-57de-48ab-9437-0f31bf2b68fe service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 for instance with vm_state building and task_state spawning.
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:44 user nova-compute[75634]: WARNING nova.compute.manager [req-a2f436b0-ae53-4403-a010-8451fbaa1ba8 req-d4be89e8-3c9f-4376-bdc9-2c0fab00d550 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 for instance with vm_state building and task_state spawning.
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e64a462f-9103-4e72-9b47-0877197f2517 req-0d50fc24-106d-4a81-84e0-80198c91d5ac service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe for instance with vm_state building and task_state spawning.
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:46 user nova-compute[75634]: WARNING nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 for instance with vm_state building and task_state spawning.
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:46 user nova-compute[75634]: WARNING nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 for instance with vm_state building and task_state spawning.
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:46 user nova-compute[75634]: WARNING nova.compute.manager [req-11561974-1bd1-4ddf-b42a-5ea3e7f0d6a6 req-f1bd36f9-e665-4b2d-9864-0ddabeb84beb service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 for instance with vm_state building and task_state spawning.
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:46 user nova-compute[75634]: WARNING nova.compute.manager [req-9edf1bf7-08d1-4686-a889-d092e1ae050b req-c270c383-34f7-48d5-9c9c-577e4fb1d23d service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 for instance with vm_state building and task_state spawning.
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:37:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance spawned successfully.
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:37:47 user nova-compute[75634]: INFO nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Took 10.84 seconds to spawn the instance on the hypervisor.
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:37:47 user nova-compute[75634]: WARNING nova.compute.manager [req-dd975030-1e38-4741-85ee-e46161b610b5 req-26e50497-cc16-4cd8-ae53-71a1c5c3fe24 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe for instance with vm_state building and task_state spawning.
Nov 15 18:37:47 user nova-compute[75634]: INFO nova.compute.manager [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Took 30.98 seconds to build instance.
Nov 15 18:37:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9f7fde0c-73c4-496d-9c33-7bb89bdabed9 tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.098s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:37:59 user nova-compute[75634]: INFO nova.compute.claims [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Claim successful on node user
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:37:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:37:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.policy [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '214f13af13d64a1a83b311fcd6ef77c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fff42c46264ff583eedea85f2f1bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:38:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Creating image(s)
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "/opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "/opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "/opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk 1073741824" returned: 0 in 0.052s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Cannot resize image /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Ensure instance console log exists: /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Successfully created port: da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Successfully updated port: da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquired lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-changed-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Refreshing instance network info cache due to event network-changed-da47a75e-d09e-4aa7-a704-560afed2588e. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] Acquiring lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updating instance_info_cache with network_info: [{"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Releasing lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Instance network_info: |[{"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] Acquired lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.neutron [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Refreshing network info cache for port da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Start _get_guest_xml network_info=[{"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:38:01 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:01 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6348526',id=12,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGiW7D4yR/Nsf6vmxJWA0NLHiOTHYlsqUFO6y06TjyoZ3AMne4nxo4HW0Pir5mefu9wTNHcPvbb+r++B44pMJQxj41RydhnAeozPfSXVbOsFZuHVR77jDLwj/mrFMmaaA==',key_name='tempest-keypair-1843885164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9fff42c46264ff583eedea85f2f1bba',ramdisk_id='',reservation_id='r-kz9k9mas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214f13af13d64a1a83b311fcd6ef77c0',uuid=23714f8f-5f5d-4ec2-907d-c5ed8346d0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converting VIF {"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lazy-loading 'pci_devices' on Instance uuid 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:38:01 user nova-compute[75634]:   <uuid>23714f8f-5f5d-4ec2-907d-c5ed8346d0f1</uuid>
Nov 15 18:38:01 user nova-compute[75634]:   <name>instance-0000000c</name>
Nov 15 18:38:01 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:38:01 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:38:01 user nova-compute[75634]:   <metadata>
Nov 15 18:38:01 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:38:01 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650</nova:name>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:38:01</nova:creationTime>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:38:01 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:38:01 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:owner>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:user uuid="214f13af13d64a1a83b311fcd6ef77c0">tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member</nova:user>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:project uuid="e9fff42c46264ff583eedea85f2f1bba">tempest-TestServerVolumeAttachScenarioOldVersion-1734844809</nova:project>
Nov 15 18:38:01 user nova-compute[75634]:       </nova:owner>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:38:01 user nova-compute[75634]:       <nova:ports>
Nov 15 18:38:01 user nova-compute[75634]:         <nova:port uuid="da47a75e-d09e-4aa7-a704-560afed2588e">
Nov 15 18:38:01 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:38:01 user nova-compute[75634]:         </nova:port>
Nov 15 18:38:01 user nova-compute[75634]:       </nova:ports>
Nov 15 18:38:01 user nova-compute[75634]:     </nova:instance>
Nov 15 18:38:01 user nova-compute[75634]:   </metadata>
Nov 15 18:38:01 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:38:01 user nova-compute[75634]:     <system>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="serial">23714f8f-5f5d-4ec2-907d-c5ed8346d0f1</entry>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="uuid">23714f8f-5f5d-4ec2-907d-c5ed8346d0f1</entry>
Nov 15 18:38:01 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:38:01 user nova-compute[75634]:     </system>
Nov 15 18:38:01 user nova-compute[75634]:   </sysinfo>
Nov 15 18:38:01 user nova-compute[75634]:   <os>
Nov 15 18:38:01 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:38:01 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:38:01 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:38:01 user nova-compute[75634]:   </os>
Nov 15 18:38:01 user nova-compute[75634]:   <features>
Nov 15 18:38:01 user nova-compute[75634]:     <acpi/>
Nov 15 18:38:01 user nova-compute[75634]:     <apic/>
Nov 15 18:38:01 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:38:01 user nova-compute[75634]:   </features>
Nov 15 18:38:01 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:38:01 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:38:01 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:38:01 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:38:01 user nova-compute[75634]:   </clock>
Nov 15 18:38:01 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:38:01 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:38:01 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:38:01 user nova-compute[75634]:   </cpu>
Nov 15 18:38:01 user nova-compute[75634]:   <devices>
Nov 15 18:38:01 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:38:01 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:38:01 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk"/>
Nov 15 18:38:01 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:38:01 user nova-compute[75634]:     </disk>
Nov 15 18:38:01 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:38:01 user nova-compute[75634]:       <mac address="fa:16:3e:04:51:1b"/>
Nov 15 18:38:01 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:38:01 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:38:01 user nova-compute[75634]:       <target dev="tapda47a75e-d0"/>
Nov 15 18:38:01 user nova-compute[75634]:     </interface>
Nov 15 18:38:01 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:38:01 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/console.log" append="off"/>
Nov 15 18:38:01 user nova-compute[75634]:     </serial>
Nov 15 18:38:01 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:38:01 user nova-compute[75634]:     <video>
Nov 15 18:38:01 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:38:01 user nova-compute[75634]:     </video>
Nov 15 18:38:01 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:38:01 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:38:01 user nova-compute[75634]:     </rng>
Nov 15 18:38:01 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:38:01 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:38:01 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:38:01 user nova-compute[75634]:     </memballoon>
Nov 15 18:38:01 user nova-compute[75634]:   </devices>
Nov 15 18:38:01 user nova-compute[75634]: </domain>
Nov 15 18:38:01 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6348526',id=12,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGiW7D4yR/Nsf6vmxJWA0NLHiOTHYlsqUFO6y06TjyoZ3AMne4nxo4HW0Pir5mefu9wTNHcPvbb+r++B44pMJQxj41RydhnAeozPfSXVbOsFZuHVR77jDLwj/mrFMmaaA==',key_name='tempest-keypair-1843885164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9fff42c46264ff583eedea85f2f1bba',ramdisk_id='',reservation_id='r-kz9k9mas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214f13af13d64a1a83b311fcd6ef77c0',uuid=23714f8f-5f5d-4ec2-907d-c5ed8346d0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converting VIF {"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG os_vif [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '471409a1-bc6e-5e16-b705-6b186887c3e6', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda47a75e-d0, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda47a75e-d0, col_values=(('qos', UUID('b6beae07-e092-411b-a005-03a6e99a84a2')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda47a75e-d0, col_values=(('external_ids', {'iface-id': 'da47a75e-d09e-4aa7-a704-560afed2588e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:51:1b', 'vm-uuid': '23714f8f-5f5d-4ec2-907d-c5ed8346d0f1'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:01 user nova-compute[75634]: INFO os_vif [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0')
Nov 15 18:38:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] No VIF found with MAC fa:16:3e:04:51:1b, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updated VIF entry in instance network info cache for port da47a75e-d09e-4aa7-a704-560afed2588e. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updating instance_info_cache with network_info: [{"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8c3e1aa-c7d7-4838-9a27-d099f2341079 req-a9281324-ef59-4db8-88b2-c25f337c17c8 service nova] Releasing lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] No waiting events found dispatching network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:03 user nova-compute[75634]: WARNING nova.compute.manager [req-b12be540-a4db-4986-bcfb-60d0f5923285 req-b7d6a002-4947-4046-91a7-a62891fd7565 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received unexpected event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e for instance with vm_state building and task_state spawning.
Nov 15 18:38:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:38:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Instance spawned successfully.
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:05 user nova-compute[75634]: INFO nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 15 18:38:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:38:05 user nova-compute[75634]: INFO nova.compute.manager [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Took 6.60 seconds to build instance.
Nov 15 18:38:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3d863183-0e01-4f83-84fd-f8dafd92fd96 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.705s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] No waiting events found dispatching network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:06 user nova-compute[75634]: WARNING nova.compute.manager [req-20093256-f3f4-45c6-87c0-252125d3dd52 req-8aef48c6-d92e-4c2e-93f3-6a1f7c1efa1f service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received unexpected event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e for instance with vm_state building and task_state spawning.
Nov 15 18:38:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:38:16 user nova-compute[75634]: INFO nova.compute.claims [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Claim successful on node user
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:38:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:16 user nova-compute[75634]: DEBUG nova.policy [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099e827d7f0847fba5644d6f5eef6743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efda14818c224f2382438fcf2c1c39c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:38:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Creating image(s)
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "/opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "/opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "/opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk 1073741824" returned: 0 in 0.053s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Successfully created port: 8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.166s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Cannot resize image /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Ensure instance console log exists: /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Successfully updated port: 8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquired lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-changed-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Refreshing instance network info cache due to event network-changed-8a66af1d-34fc-4230-8b38-318d8f9d29b1. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] Acquiring lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Updating instance_info_cache with network_info: [{"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Releasing lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Instance network_info: |[{"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] Acquired lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Refreshing network info cache for port 8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Start _get_guest_xml network_info=[{"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:38:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736817865',display_name='tempest-ServersNegativeTestJSON-server-736817865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736817865',id=13,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-gyvlrhlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:38:17Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=99fe65b6-b8ff-4ee7-9606-5a9b90260b48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.objects.instance [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lazy-loading 'pci_devices' on Instance uuid 99fe65b6-b8ff-4ee7-9606-5a9b90260b48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:38:18 user nova-compute[75634]:   <uuid>99fe65b6-b8ff-4ee7-9606-5a9b90260b48</uuid>
Nov 15 18:38:18 user nova-compute[75634]:   <name>instance-0000000d</name>
Nov 15 18:38:18 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:38:18 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:38:18 user nova-compute[75634]:   <metadata>
Nov 15 18:38:18 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:38:18 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:name>tempest-ServersNegativeTestJSON-server-736817865</nova:name>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:38:18</nova:creationTime>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:38:18 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:38:18 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:owner>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:user uuid="099e827d7f0847fba5644d6f5eef6743">tempest-ServersNegativeTestJSON-1798425367-project-member</nova:user>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:project uuid="efda14818c224f2382438fcf2c1c39c5">tempest-ServersNegativeTestJSON-1798425367</nova:project>
Nov 15 18:38:18 user nova-compute[75634]:       </nova:owner>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:38:18 user nova-compute[75634]:       <nova:ports>
Nov 15 18:38:18 user nova-compute[75634]:         <nova:port uuid="8a66af1d-34fc-4230-8b38-318d8f9d29b1">
Nov 15 18:38:18 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:38:18 user nova-compute[75634]:         </nova:port>
Nov 15 18:38:18 user nova-compute[75634]:       </nova:ports>
Nov 15 18:38:18 user nova-compute[75634]:     </nova:instance>
Nov 15 18:38:18 user nova-compute[75634]:   </metadata>
Nov 15 18:38:18 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:38:18 user nova-compute[75634]:     <system>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="serial">99fe65b6-b8ff-4ee7-9606-5a9b90260b48</entry>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="uuid">99fe65b6-b8ff-4ee7-9606-5a9b90260b48</entry>
Nov 15 18:38:18 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:38:18 user nova-compute[75634]:     </system>
Nov 15 18:38:18 user nova-compute[75634]:   </sysinfo>
Nov 15 18:38:18 user nova-compute[75634]:   <os>
Nov 15 18:38:18 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:38:18 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:38:18 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:38:18 user nova-compute[75634]:   </os>
Nov 15 18:38:18 user nova-compute[75634]:   <features>
Nov 15 18:38:18 user nova-compute[75634]:     <acpi/>
Nov 15 18:38:18 user nova-compute[75634]:     <apic/>
Nov 15 18:38:18 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:38:18 user nova-compute[75634]:   </features>
Nov 15 18:38:18 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:38:18 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:38:18 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:38:18 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:38:18 user nova-compute[75634]:   </clock>
Nov 15 18:38:18 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:38:18 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:38:18 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:38:18 user nova-compute[75634]:   </cpu>
Nov 15 18:38:18 user nova-compute[75634]:   <devices>
Nov 15 18:38:18 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:38:18 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:38:18 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk"/>
Nov 15 18:38:18 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:38:18 user nova-compute[75634]:     </disk>
Nov 15 18:38:18 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:38:18 user nova-compute[75634]:       <mac address="fa:16:3e:a7:01:75"/>
Nov 15 18:38:18 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:38:18 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:38:18 user nova-compute[75634]:       <target dev="tap8a66af1d-34"/>
Nov 15 18:38:18 user nova-compute[75634]:     </interface>
Nov 15 18:38:18 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:38:18 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/console.log" append="off"/>
Nov 15 18:38:18 user nova-compute[75634]:     </serial>
Nov 15 18:38:18 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:38:18 user nova-compute[75634]:     <video>
Nov 15 18:38:18 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:38:18 user nova-compute[75634]:     </video>
Nov 15 18:38:18 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:38:18 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:38:18 user nova-compute[75634]:     </rng>
Nov 15 18:38:18 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:38:18 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:38:18 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:38:18 user nova-compute[75634]:     </memballoon>
Nov 15 18:38:18 user nova-compute[75634]:   </devices>
Nov 15 18:38:18 user nova-compute[75634]: </domain>
Nov 15 18:38:18 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736817865',display_name='tempest-ServersNegativeTestJSON-server-736817865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736817865',id=13,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-gyvlrhlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:38:17Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=99fe65b6-b8ff-4ee7-9606-5a9b90260b48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG os_vif [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06c4c85f-d18b-5dcf-8cd1-885915f93c42', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a66af1d-34, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a66af1d-34, col_values=(('qos', UUID('df39c95f-9d9b-4863-81ca-aad0a57869f4')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a66af1d-34, col_values=(('external_ids', {'iface-id': '8a66af1d-34fc-4230-8b38-318d8f9d29b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:01:75', 'vm-uuid': '99fe65b6-b8ff-4ee7-9606-5a9b90260b48'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:18 user nova-compute[75634]: INFO os_vif [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34')
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] No VIF found with MAC fa:16:3e:a7:01:75, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Updated VIF entry in instance network info cache for port 8a66af1d-34fc-4230-8b38-318d8f9d29b1. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Updating instance_info_cache with network_info: [{"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ce5aee3-011d-46d5-b026-ac6af8d35f46 req-42f85c71-a19a-498c-ad4d-d90740d1f446 service nova] Releasing lock "refresh_cache-99fe65b6-b8ff-4ee7-9606-5a9b90260b48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:38:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing instance network info cache due to event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] No waiting events found dispatching network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:22 user nova-compute[75634]: WARNING nova.compute.manager [req-e24d2f1f-fff7-449d-8d98-6268a47f6201 req-642ffb44-1704-421f-afbf-2919a434a771 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received unexpected event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 for instance with vm_state building and task_state spawning.
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-changed-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing instance network info cache due to event network-changed-5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing network info cache for port 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=6690MB free_disk=25.468109130859375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Instance spawned successfully.
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:38:22 user nova-compute[75634]: INFO nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:38:22 user nova-compute[75634]: INFO nova.compute.manager [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Took 6.73 seconds to build instance.
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 65848bf6-8074-4bab-804c-342f3edcc0cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dca2e952-fba6-40b7-8952-5524606cebaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 47112be8-147d-4f27-853c-d306ae4bfe19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 99fe65b6-b8ff-4ee7-9606-5a9b90260b48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:38:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-050184fd-7d01-4704-8fc4-971756373e1b tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.830s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] No waiting events found dispatching network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:23 user nova-compute[75634]: WARNING nova.compute.manager [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received unexpected event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 for instance with vm_state active and task_state None.
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-changed-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Refreshing instance network info cache due to event network-changed-3788bac0-17f5-41ed-889d-2649ea453783. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Refreshing network info cache for port 3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updated VIF entry in instance network info cache for port 5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated VIF entry in instance network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b88faa90-bd3a-4b06-b0d5-50f2f11dc476 req-838611e0-9c2a-484b-97ba-42ec6208ec09 service nova] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-47007941-9cf7-4643-81b9-d6a560d142ed req-3f4c3907-aae9-4a2e-a2aa-b228b61500de service nova] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:23 user nova-compute[75634]: INFO nova.compute.manager [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Shelving
Nov 15 18:38:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:24 user nova-compute[75634]: WARNING nova.compute.manager [req-3fa41adf-e731-4092-9bc1-d4b934b4d62e req-1758ec01-295d-4adf-bd78-507e49e198fd service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state shelving.
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.network.neutron [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updated VIF entry in instance network info cache for port 3788bac0-17f5-41ed-889d-2649ea453783. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.network.neutron [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f8c4b5ee-78cb-4c02-86e8-d99283fc9cf5 req-80ba5e91-60e9-4e0c-ae51-e54a1949305e service nova] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:38:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance destroyed successfully.
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:38:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Beginning cold snapshot process
Nov 15 18:38:25 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk /opt/stack/data/nova/instances/snapshots/tmpwxbaa7b5/cc29d90c155c4b4299a598f28185a87b {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk /opt/stack/data/nova/instances/snapshots/tmpwxbaa7b5/cc29d90c155c4b4299a598f28185a87b" returned: 0 in 0.806s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Snapshot extracted, beginning image upload
Nov 15 18:38:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:26 user nova-compute[75634]: WARNING nova.compute.manager [req-aed8c57f-edcc-47ad-9c8c-a94527bd99a6 req-7dc6ef9b-5b20-4eb8-b264-c90fa9b3fbca service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 18:38:28 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Snapshot image upload complete
Nov 15 18:38:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:38:28 user nova-compute[75634]: INFO nova.compute.manager [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Shelve offloading
Nov 15 18:38:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:28 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance destroyed successfully.
Nov 15 18:38:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:38:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.network.neutron [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance destroyed successfully.
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'resources' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB7iOyoiiOgyqpFSqgBP8vgPi0Pl4dT/C57yqn88S6pO7+tpJCZE1OZQ6q9PuMUlXlNZXb3PuJcLqM6M+WYtpymDEhY7IQ42Cf9jJTK4q7hhK+ku29pS2DUnARQGkf6pA==',key_name='tempest-keypair-1072552389',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:38:28.521903',shelved_host='user',shelved_image_id='59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG os_vif [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5abcd712-26, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7deacd5b-b32b-4480-9c5d-cb8f2d3012d6) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:29 user nova-compute[75634]: INFO os_vif [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26')
Nov 15 18:38:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Deleting instance files /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7_del
Nov 15 18:38:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Deletion of /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7_del complete
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-changed-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing instance network info cache due to event network-changed-5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing network info cache for port 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75634) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 18:38:29 user nova-compute[75634]: INFO nova.virt.libvirt.host [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] UEFI support detected
Nov 15 18:38:29 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Deleted allocations for instance d14a0c65-0ba1-4919-80b8-5295e100a7f7
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'numa_topology' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.objects.base [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<d14a0c65-0ba1-4919-80b8-5295e100a7f7> lazy-loaded attributes: resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updated VIF entry in instance network info cache for port 5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5abcd712-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4130b5bf-86da-4f37-a9cd-e0b972068800 req-547e0698-9635-4932-a2fb-c221901cef5e service nova] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-800080ca-1940-4e03-8b0d-b18329a98f63 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.827s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-changed-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Refreshing instance network info cache due to event network-changed-711c0187-65d5-4792-bb1c-1d7da8200967. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] Acquiring lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] Acquired lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Refreshing network info cache for port 711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:31 user nova-compute[75634]: DEBUG nova.network.neutron [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updated VIF entry in instance network info cache for port 711c0187-65d5-4792-bb1c-1d7da8200967. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:31 user nova-compute[75634]: DEBUG nova.network.neutron [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating instance_info_cache with network_info: [{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0fae041-0b3a-4df5-a34c-806140a0894a req-8b575ff4-6434-4c53-81b3-86e304b76587 service nova] Releasing lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-changed-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Refreshing instance network info cache due to event network-changed-7f6513a9-437c-48d7-a512-e6cd0c370628. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] Acquiring lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] Acquired lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:32 user nova-compute[75634]: DEBUG nova.network.neutron [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Refreshing network info cache for port 7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lazy-loading 'flavor' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updated VIF entry in instance network info cache for port 7f6513a9-437c-48d7-a512-e6cd0c370628. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updating instance_info_cache with network_info: [{"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-09f4781e-9c0f-46af-8ac2-ffd55ab08f4f req-14b0a717-834a-494c-8984-20fecce68460 service nova] Releasing lock "refresh_cache-7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'flavor' on Instance uuid fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:33 user nova-compute[75634]: INFO nova.compute.manager [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attaching volume 5f723df4-d899-4ae0-9e5a-17470bf7f550 to /dev/vdb
Nov 15 18:38:33 user nova-compute[75634]: DEBUG os_brick.utils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab720954-99ca-4b7d-8644-92277aaab8ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd26fea-f9fb-49ad-aee5-b0c61a93a6ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc6e280-63d6-491c-889e-adbe00ceab30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[338abde7-df45-4de0-8de0-5660d19915ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:33 user nova-compute[75634]: INFO nova.compute.manager [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Attaching volume 9e4eac55-20c3-41c0-903c-c5d297debd7b to /dev/vdb
Nov 15 18:38:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:34 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ea872-5885-431c-b623-6f5bcecb2833]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.utils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updating existing volume attachment record: 63f4e905-5fb2-4fa8-8ff7-fc725c9d2fca {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.utils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d5781-19ea-494d-804e-c95189bb8303]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe2cb58-9d5a-460e-ada5-3fa8982c968f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786cc93-ebf9-4bf3-9f04-4cbda9086c70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c9696a-9b17-422b-9a38-31fc5b902650]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:34 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d0913-26bd-4bfe-ae8e-1ba597b8d047]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG os_brick.utils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating existing volume attachment record: 7df49521-bae1-4056-b15c-3151c8d796a3 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:38:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:38 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnsbvtJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabc9614-2aa2-4594-a957-04d994ea9830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:38 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf4760-4df6-4e47-8f78-c14c665ec1f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550] added
Nov 15 18:38:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dbfd46-746f-437d-8af8-8b9222b19fbe]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65094947-6395-4947-8ba3-cba51845f376]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjckGLbA {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjckGLbA" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd875b-99d3-4983-bfdf-4161083d6287]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjckGLbA'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde0ed6-bc3f-4aca-9d92-0898472b5a1e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7603a2d-4314-4371-8369-b5621557af11]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126c40d-9495-47bc-88ae-8fa9593be2fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]
Nov 15 18:38:39 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a10d2-e9fc-4c7d-88dc-7d51c3990133]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f8dd1-38f8-4944-907a-ae2a7a81d705]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[204a78aa-77f5-4b5b-961f-59eed6ac5c9b]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23961366637633638', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366637633638', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.326s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:40 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lazy-loading 'flavor' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea5e57-5ef9-4d6b-a4f6-4770f9a7b7ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:40 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d555f4c-3595-443a-8237-e0c229870a76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b] added
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[55911a36-cec4-4122-916a-6af4a0eedf0c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:38:40 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:40 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:38:40 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:38:40 user nova-compute[75634]:   <serial>5f723df4-d899-4ae0-9e5a-17470bf7f550</serial>
Nov 15 18:38:40 user nova-compute[75634]: </disk>
Nov 15 18:38:40 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3138047b-78e1-4b4d-ac30-6b525cd86c7f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnsbvtJE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnsbvtJE" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fd0b3-6dac-4ae6-882d-728562d9ee59]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HnsbvtJE'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a775a7b-e4a9-48b3-85a8-abd5f43ec433]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96870465-13e8-47b0-826d-5e270e53d745]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46e8065-b159-4db5-91ee-1590856e57c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260]
Nov 15 18:38:40 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dee5aa0-1fae-429f-8516-4da57d0b1c82]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab066b2-d19b-4c5f-a8df-acae3177edb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:40 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a707d10b-bfd0-4f51-ab90-57243cf22051]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] No VIF found with MAC fa:16:3e:5f:b1:45, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-38ee5f5f-a1a6-4328-8df1-7759b59eb3db tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.191s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnsbvtJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] <== connect_volume: return (2651ms) {'type': 'block', 'scsi_wwn': '23630393139393239', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630393139393239', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'flavor' on Instance uuid fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:38:41 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:41 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:38:41 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:38:41 user nova-compute[75634]:   <serial>9e4eac55-20c3-41c0-903c-c5d297debd7b</serial>
Nov 15 18:38:41 user nova-compute[75634]: </disk>
Nov 15 18:38:41 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-changed-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing instance network info cache due to event network-changed-1d52672f-2f92-4487-b730-82d4a60db5fc. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG nova.network.neutron [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing network info cache for port 1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.utils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e025df-5820-47ab-8178-582871b3de87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc695ecc-4fd2-420e-abd4-b833bc8fc264]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b6a30-bb5e-4074-ad43-bc920581dffc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5111d-e259-4b39-90f4-5c186d94be1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:41 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7b0c4-ec4d-410f-8682-10ac7e431cd8]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:41 user nova-compute[75634]: DEBUG os_brick.utils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:42 user nova-compute[75634]: INFO nova.compute.manager [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Swapping volume 5f723df4-d899-4ae0-9e5a-17470bf7f550 for 39797443-60e1-48f7-920e-38569961079b
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No VIF found with MAC fa:16:3e:09:a7:2f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-68904ae5-691b-4c4c-a2ca-9b567dfe8393 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.341s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updated VIF entry in instance network info cache for port 1d52672f-2f92-4487-b730-82d4a60db5fc. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'pci_requests' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.objects.base [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Object Instance<9eb05a7b-5f61-4c36-b751-3ba2f1f857b8> lazy-loaded attributes: flavor,pci_requests {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b38cc048-65fe-440f-8f19-d013574fce4f req-27128e6b-7e81-4317-87c3-c7b1bfcb6a15 service nova] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:42 user nova-compute[75634]: DEBUG nova.policy [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f47155df59f44ec1aff630140493b530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c94de1ba84426900d882f68f2c6e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:38:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:43 user nova-compute[75634]: INFO nova.compute.manager [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Detaching volume 9e4eac55-20c3-41c0-903c-c5d297debd7b
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Successfully created port: 65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:38:43 user nova-compute[75634]: INFO nova.virt.block_device [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Attempting to driver detach volume 9e4eac55-20c3-41c0-903c-c5d297debd7b from mountpoint /dev/vdb
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Attempting to detach device vdb from instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:38:43 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:43 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:38:43 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:38:43 user nova-compute[75634]:   <serial>9e4eac55-20c3-41c0-903c-c5d297debd7b</serial>
Nov 15 18:38:43 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:38:43 user nova-compute[75634]: </disk>
Nov 15 18:38:43 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:38:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully detached device vdb from instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 from the persistent domain config.
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:38:43 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:43 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:38:43 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:38:43 user nova-compute[75634]:   <serial>9e4eac55-20c3-41c0-903c-c5d297debd7b</serial>
Nov 15 18:38:43 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:38:43 user nova-compute[75634]: </disk>
Nov 15 18:38:43 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:38:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-changed-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Refreshing instance network info cache due to event network-changed-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] Acquiring lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] Acquired lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Refreshing network info cache for port d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Successfully updated port: 65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updated VIF entry in instance network info cache for port d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updating instance_info_cache with network_info: [{"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-104777b1-13f3-4ae1-8f42-eaea5904527b req-c3b7385a-03d3-4f42-a5f2-e1378b023acb service nova] Releasing lock "refresh_cache-db30cd06-6f39-4ee8-b229-cfa071a0ef88" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG os_vif [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0fbc03f-03ac-50d8-9ef7-6c52b01830fe', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65176b8f-69, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65176b8f-69, col_values=(('qos', UUID('404a282d-a335-4867-8e20-e8217269c2ba')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65176b8f-69, col_values=(('external_ids', {'iface-id': '65176b8f-69c0-4f65-86b5-4a895e7ed34f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ab:99', 'vm-uuid': '9eb05a7b-5f61-4c36-b751-3ba2f1f857b8'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: INFO os_vif [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69')
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] attach device xml: <interface type="ethernet">
Nov 15 18:38:45 user nova-compute[75634]:   <mac address="fa:16:3e:84:ab:99"/>
Nov 15 18:38:45 user nova-compute[75634]:   <model type="virtio"/>
Nov 15 18:38:45 user nova-compute[75634]:   <mtu size="1442"/>
Nov 15 18:38:45 user nova-compute[75634]:   <target dev="tap65176b8f-69"/>
Nov 15 18:38:45 user nova-compute[75634]: </interface>
Nov 15 18:38:45 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name hda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No VIF found with MAC fa:16:3e:28:4f:cf, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:38:45 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:38:45</nova:creationTime>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:38:45 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:38:45 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:owner>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:38:45 user nova-compute[75634]:   </nova:owner>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:38:45 user nova-compute[75634]:   <nova:ports>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:38:45 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:38:45 user nova-compute[75634]:     </nova:port>
Nov 15 18:38:45 user nova-compute[75634]:     <nova:port uuid="65176b8f-69c0-4f65-86b5-4a895e7ed34f">
Nov 15 18:38:45 user nova-compute[75634]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Nov 15 18:38:45 user nova-compute[75634]:     </nova:port>
Nov 15 18:38:45 user nova-compute[75634]:   </nova:ports>
Nov 15 18:38:45 user nova-compute[75634]: </nova:instance>
Nov 15 18:38:45 user nova-compute[75634]:  {{(pid=75634) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 18:38:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6174a901-a9c8-4953-8306-0e8c9e8570fb tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.775s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.objects.instance [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-changed-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing instance network info cache due to event network-changed-65176b8f-69c0-4f65-86b5-4a895e7ed34f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Refreshing network info cache for port 65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:46 user nova-compute[75634]: INFO nova.compute.manager [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Attaching volume 1efd5bdd-4c37-4050-b603-629e38a5c914 to /dev/vdb
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.utils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2465ba15-3498-45ac-81d9-80ca20e40a2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d0dfdc-fd7e-4b94-9b5d-7b56f0c8ad9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[796cb4e9-3e59-48a8-8508-0dd91c1b61bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5c01e-59eb-4487-a825-635c244c1ae4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:46 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cbb095-0580-4250-aa5e-18bcd135b75f]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG os_brick.utils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating existing volume attachment record: d3d5af71-a6bc-4a1a-8c34-058f759c2d45 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updated VIF entry in instance network info cache for port 65176b8f-69c0-4f65-86b5-4a895e7ed34f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:46 user nova-compute[75634]: WARNING nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f for instance with vm_state active and task_state None.
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:46 user nova-compute[75634]: WARNING nova.compute.manager [req-e98dee8a-a647-4d2b-b2cb-eebd55fbace5 req-09802e2d-f117-43a4-9196-0f9da20d60f6 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f for instance with vm_state active and task_state None.
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lazy-loading 'flavor' on Instance uuid db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '39797443-60e1-48f7-920e-38569961079b', 'serial': '39797443-60e1-48f7-920e-38569961079b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '5f723df4-d899-4ae0-9e5a-17470bf7f550', 'serial'} {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:47 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74c43d-df74-45cb-8a41-8dd28da9516d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:47 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd84f8c-1d71-41fc-a910-c89a47fc6564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b] added
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3fc51-e92f-4bb7-b0ef-f25140f7f8f6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb969d4-6d3c-46d5-97e1-da2c720bca3d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQoKGMnl {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:47 user nova-compute[75634]: INFO nova.compute.manager [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Attaching volume 958826d5-642a-4934-954d-bf238d6950a7 to /dev/sdc
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQoKGMnl" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b458634-c1c4-4e19-b627-d80bb0ad6c85]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQoKGMnl'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee9416-64ea-4372-bdab-f5e21b14eca1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e09524-791b-4000-9f55-c761a9d0aab9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9a94b-a8c4-461d-9e99-b8a56eff5763]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb56f8a5-eee6-40ad-bf71-89bd87c919c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1857e2-4fdd-46dd-b033-38d5836ce539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c2138a-3a19-4afb-8131-6e594208d90f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6f2f1-cf0d-42d4-a78d-a9374e62205f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260]
Nov 15 18:38:47 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:47 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[20358992-6ecc-4473-8665-b60750672500]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updating existing volume attachment record: cdda1d7a-6fb0-4b18-8f77-df85cea170fa {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c16ad-1714-42b9-a1e5-824ebe0420a0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f7ed1-0080-48c7-ac58-cc9450b07833]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6de7dbf-a5a4-43c1-b6b6-495e71e45914]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26663656132363130', 'path': '/dev/sdh'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663656132363130', 'path': '/dev/sdh'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lazy-loading 'flavor' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-changed-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Refreshing instance network info cache due to event network-changed-5d3caf5f-9f37-4a79-abe5-c26c67dc074c. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] Acquiring lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] Acquired lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Refreshing network info cache for port 5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG nova.objects.instance [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lazy-loading 'flavor' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:49 user nova-compute[75634]: INFO nova.compute.manager [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Attaching volume 6b05c39d-d30e-42dd-beba-9b2d2c8d445a to /dev/vdb
Nov 15 18:38:49 user nova-compute[75634]: DEBUG nova.network.neutron [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updated VIF entry in instance network info cache for port 5d3caf5f-9f37-4a79-abe5-c26c67dc074c. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG nova.network.neutron [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating instance_info_cache with network_info: [{"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f175730c-ec7d-4c71-b500-ff2f4c80db68 req-8ba27b54-f699-4d5a-8dc5-c33a900d77ae service nova] Releasing lock "refresh_cache-65848bf6-8074-4bab-804c-342f3edcc0cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG os_brick.utils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e22cb-e113-4c2e-849e-0742711582f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f306359-a9ee-4138-9e4e-bf55497c1575]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da399f-c767-42d2-b796-6715bbad1aa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db095019-93c5-4d82-bfdc-426c2248d485]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 230686720 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:50 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[456abb38-6acf-4410-aa8d-0c600c4b37c4]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG os_brick.utils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updating existing volume attachment record: 62f46213-e1c4-4ed6-867f-25672076cc58 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:50 user nova-compute[75634]: INFO nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Rebuilding instance
Nov 15 18:38:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-changed-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Refreshing instance network info cache due to event network-changed-dcc177e0-f225-4479-a6d0-0ba2c388b070. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Acquiring lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Acquired lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Refreshing network info cache for port dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 444596224 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance destroyed successfully.
Nov 15 18:38:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance destroyed successfully.
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-915106744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d3caf5f-9f, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e1d0bc7-1d0e-4ed2-ad64-374f075bc67c) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:38:51 user nova-compute[75634]: INFO os_vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f')
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:51 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb825db2-1554-4b4c-b6c5-f3d5d8d6d099]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:38:51 user nova-compute[75634]: No targets found.
Nov 15 18:38:51 user nova-compute[75634]: iSNS:
Nov 15 18:38:51 user nova-compute[75634]: No targets found.
Nov 15 18:38:51 user nova-compute[75634]: STATIC:
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:38:51 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:51 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:51 user nova-compute[75634]: FIRMWARE:
Nov 15 18:38:51 user nova-compute[75634]: No targets found.
Nov 15 18:38:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:38:51 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:38:51 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa35c1dc-a402-49ba-af49-bf1a66f5ed74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817b679-4ec6-4c45-bcfd-9522394679b2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:51 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68107640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1611ddbe-c634-4a9a-b7d5-e4dba0039edc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updated VIF entry in instance network info cache for port dcc177e0-f225-4479-a6d0-0ba2c388b070. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updating instance_info_cache with network_info: [{"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df95e7-2eef-42c0-99e2-78ed80821cf3]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b3f00b-e202-454a-acee-d9da23c22e1e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Releasing lock "refresh_cache-dca2e952-fba6-40b7-8952-5524606cebaf" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:51 user nova-compute[75634]: WARNING nova.compute.manager [req-a8ae08ed-87b1-4cd0-9093-6a488bd9b273 req-2648eafa-98f2-4627-9d94-00d6fe986ff4 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state rebuilding.
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8170f3-26fb-4fee-ba1c-a9fbe2b9e6b5]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23663323163623461', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b8e9a060', '/dev/disk/by-id/scsi-1SCST_BIOb8e9a060-6c21cb4ade5624b9') {{(pid=85900) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0642c0c-ad3f-46fb-be2f-d601a8a12b41]: (4, None) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 527433728 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb9315-3f76-4888-a32b-86c9f0588c02]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe2451-36d9-4beb-ad45-9af4cde90097]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]
Nov 15 18:38:51 user nova-compute[75634]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56155342-c145-4a92-a8c8-e487987b3dea]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== disconnect_volume: return (404ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:38:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deleting instance files /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc_del
Nov 15 18:38:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deletion of /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc_del complete
Nov 15 18:38:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 649068544 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:38:53 user nova-compute[75634]: WARNING nova.compute.manager [req-b5b66d6a-11b7-4e3a-b00e-846f7ee567f3 req-6fe901e2-4f71-4df4-bc0d-c97e0fd121a3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state rebuilding.
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlUOynow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:53 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 922746880 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0baabf9-f97b-4454-afe2-9ba730c428ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:53 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e6925-046c-47f5-8709-b272e9602bcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7] added
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2418332c-5a98-4ca3-a7f4-5b8f6f7725ab]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be22e0-557e-4894-b175-bf39e39cbffb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlUOynow {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlUOynow" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[817243a4-c7a8-40e5-963b-96407ddae0f3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlUOynow'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f15cf9e-58bb-4a58-885e-fea352f68bf5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcba4f9-1237-4229-9763-f30f3ca5c9df]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c01db8-7404-4a99-96e3-eb8bbe27b985]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260]
Nov 15 18:38:53 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fea905-e16b-4743-aa84-cb14cd3acb4e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 65848bf6-8074-4bab-804c-342f3edcc0cc could not be found.
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fff995-dba9-4074-8536-f19d69f4037b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:53 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c220563-3a88-41bd-b982-fe2c9cc12d9f]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:54 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlUOynow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23834643732626139', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834643732626139', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.031s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lazy-loading 'flavor' on Instance uuid db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6928ca0c-6579-4af3-899b-18ec1bc21ca9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]: iSNS:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]: STATIC:
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: FIRMWARE:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:38:54 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:38:54 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:38:54 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:54 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:38:54 user nova-compute[75634]:   <target dev="sdc" bus="scsi"/>
Nov 15 18:38:54 user nova-compute[75634]:   <serial>958826d5-642a-4934-954d-bf238d6950a7</serial>
Nov 15 18:38:54 user nova-compute[75634]:   <address type="drive" controller="0" unit="2"/>
Nov 15 18:38:54 user nova-compute[75634]: </disk>
Nov 15 18:38:54 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3067587e-1dbc-409b-bde3-d33ea43a39f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f22981-4a87-4546-acc5-01436e9daf7c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4452e320>, {}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Disconnecting from: [] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== disconnect_volume: return (1109ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.365s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff8e81d-b8c0-4283-bab5-cc4fcd780a7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]: iSNS:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]: STATIC:
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:38:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:38:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:38:54 user nova-compute[75634]: FIRMWARE:
Nov 15 18:38:54 user nova-compute[75634]: No targets found.
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:38:54 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:38:54 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c313d7-1e02-452c-9884-75660e0d91a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8294c2-a366-4169-aa42-5cc42f05c735]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:54 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b685de830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c09e6-fa76-4204-8817-a9d19d8841d7]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[194c5810-6e02-4e6d-b515-9bccecc0bca6]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[597543f9-5848-4a3a-a961-877840881921]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f635573c-f79e-41a4-9f95-687790d88dca]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46bd078-76b5-493c-8390-0ddcbe454659]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9583e46e-971f-4fe5-9e76-42eb9a7e7af7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]
Nov 15 18:38:55 user nova-compute[75634]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:55 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422edf8-b90d-4232-80a2-9dc75625315b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== disconnect_volume: return (707ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No BDM found with device name sda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] No VIF found with MAC fa:16:3e:7b:80:82, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Preparing to wait for external event volume-reimaged-d1688aff-0b69-4d67-85ac-a78bb49f11a0 {{(pid=75634) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '39797443-60e1-48f7-920e-38569961079b', 'serial'} {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 18:38:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: removing Cinder connection for volume 5f723df4-d899-4ae0-9e5a-17470bf7f550 {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 18:38:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5c08ff98-a250-41ef-87db-a5894f362acd tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.131s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: Updating volume 5f723df4-d899-4ae0-9e5a-17470bf7f550 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AQoKGMnl", "auth_password": "aRpJ5ObNI1vkEy", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "39797443-60e1-48f7-920e-38569961079b"}, "status": "reserved", "instance": "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e", "attached_at": "", "detached_at": "", "volume_id": "39797443-60e1-48f7-920e-38569961079b", "serial": "39797443-60e1-48f7-920e-38569961079b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '39797443-60e1-48f7-920e-38569961079b', 'no_device': None, 'attachment_id': '3fe21c30-a249-436b-aa0e-9995914e1080'} {{(pid=75634) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4adb238f-af46-45ee-afe3-2331561dbae4 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.289s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtAbDFuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:57 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497a5da-c628-457a-9018-2b3bdc54eb75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:57 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2dc1a-f5a5-4cc2-90eb-ffd5de409c45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914] added
Nov 15 18:38:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcorDekC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96365c07-709a-4204-8efa-62f9ca2be1b7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.utils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac3360-0a31-408a-b029-d34c481abb4a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtAbDFuC {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555082e-8cd8-404c-91b3-228efd29182f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtAbDFuC" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[12faca10-78b2-4eff-ab5b-90a7e3f69921]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qtAbDFuC'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb544f-b5b1-47d9-a904-badcf7c72393]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca4afe-9b7d-443b-a468-4c922bfc631d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d7e97d-3716-44f4-b44f-b4cfd3ac5808]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d009103b-c238-4bd0-8d0c-4cff6bb6bcf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1de2f11-b662-4912-9810-30a8a51f5654]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:57 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:38:57 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e965fbd-ee53-44ef-a2c6-26587ca5deab]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:38:57 user nova-compute[75634]: DEBUG os_brick.utils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:58 user nova-compute[75634]: INFO nova.compute.manager [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Detaching volume 958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe54e887-e23a-423d-8de3-ba3b17d37c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260]
Nov 15 18:38:58 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:58 user nova-compute[75634]: INFO nova.virt.block_device [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Attempting to driver detach volume 958826d5-642a-4934-954d-bf238d6950a7 from mountpoint /dev/sdc
Nov 15 18:38:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Attempting to detach device sdc from instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:38:58 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:58 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:38:58 user nova-compute[75634]:   <target dev="sdc" bus="scsi"/>
Nov 15 18:38:58 user nova-compute[75634]:   <serial>958826d5-642a-4934-954d-bf238d6950a7</serial>
Nov 15 18:38:58 user nova-compute[75634]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 18:38:58 user nova-compute[75634]: </disk>
Nov 15 18:38:58 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ed063-1201-4935-93b7-0b9fcdb0c4bf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Successfully detached device sdc from instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 from the persistent domain config.
Nov 15 18:38:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:38:58 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:58 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:38:58 user nova-compute[75634]:   <target dev="sdc" bus="scsi"/>
Nov 15 18:38:58 user nova-compute[75634]:   <serial>958826d5-642a-4934-954d-bf238d6950a7</serial>
Nov 15 18:38:58 user nova-compute[75634]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 18:38:58 user nova-compute[75634]: </disk>
Nov 15 18:38:58 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:38:58 user nova-compute[75634]: INFO nova.compute.manager [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Swapping volume 39797443-60e1-48f7-920e-38569961079b for 5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e6d72-ae4e-49f7-9e92-684a6e706218]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:58 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b571d-45a5-4b09-9339-1bec78aaf2ba]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtAbDFuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23138376364386431', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138376364386431', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.357s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:38:59 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2b96c-ae64-4eac-b0ce-83dee8d99de3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:38:59 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:38:59 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:38:59 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:38:59 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:38:59 user nova-compute[75634]:   <serial>1efd5bdd-4c37-4050-b603-629e38a5c914</serial>
Nov 15 18:38:59 user nova-compute[75634]: </disk>
Nov 15 18:38:59 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a55e5-afd6-42fb-a6ac-07dcdc4f1075]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a] added
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51dd295-b109-4395-bfcb-d685876a6808]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2efcaa2-2b58-4e42-9829-6dc0c61660bc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcorDekC {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcorDekC" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2369fa3-9310-490d-8753-d4538913279f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcorDekC'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a446db-9cd2-44fc-8364-f58eea216597]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[71353f40-09bb-4c46-9bb5-7693069fcbbc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1056697d-64b8-4d56-98d1-b5cc5254fcad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260]
Nov 15 18:38:59 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260] successful.
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1027c500-933a-4206-ab6f-914a2c3345d0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c969123b-c18b-417d-931e-790d63a535c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:38:59 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:38:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[636c1305-cd98-4abd-8510-ecdd057ee64d]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcorDekC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No BDM found with device name hda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] No VIF found with MAC fa:16:3e:28:4f:cf, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:38:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-441273ca-ce11-4ad2-ac8f-8ea1aeb26824 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.327s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] <== connect_volume: return (2754ms) {'type': 'block', 'scsi_wwn': '26237663137363939', 'path': '/dev/sdi'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237663137363939', 'path': '/dev/sdi'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lazy-loading 'flavor' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 18:39:00 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:00 user nova-compute[75634]:   <source dev="/dev/sdi"/>
Nov 15 18:39:00 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:00 user nova-compute[75634]:   <serial>6b05c39d-d30e-42dd-beba-9b2d2c8d445a</serial>
Nov 15 18:39:00 user nova-compute[75634]: </disk>
Nov 15 18:39:00 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] No VIF found with MAC fa:16:3e:15:20:69, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-be7888b3-87e7-4590-9f1b-2f65b9baadc0 tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.598s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:01 user nova-compute[75634]: INFO nova.compute.manager [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Detaching volume 1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:01 user nova-compute[75634]: INFO nova.virt.block_device [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Attempting to driver detach volume 1efd5bdd-4c37-4050-b603-629e38a5c914 from mountpoint /dev/vdb
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Attempting to detach device vdb from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:01 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:39:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:01 user nova-compute[75634]:   <serial>1efd5bdd-4c37-4050-b603-629e38a5c914</serial>
Nov 15 18:39:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 18:39:01 user nova-compute[75634]: </disk>
Nov 15 18:39:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully detached device vdb from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the persistent domain config.
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:39:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:01 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:39:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:01 user nova-compute[75634]:   <serial>1efd5bdd-4c37-4050-b603-629e38a5c914</serial>
Nov 15 18:39:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 18:39:01 user nova-compute[75634]: </disk>
Nov 15 18:39:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] volume_snapshot_create: create_info: {'snapshot_id': 'd662b8d5-5620-40ad-9836-f55ecf7cdcee', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75634) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] snap xml: <domainsnapshot>
Nov 15 18:39:02 user nova-compute[75634]:   <disks>
Nov 15 18:39:02 user nova-compute[75634]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 15 18:39:02 user nova-compute[75634]:       <source file="/dev/new_file"/>
Nov 15 18:39:02 user nova-compute[75634]:     </disk>
Nov 15 18:39:02 user nova-compute[75634]:     <disk name="vda" snapshot="no"/>
Nov 15 18:39:02 user nova-compute[75634]:   </disks>
Nov 15 18:39:02 user nova-compute[75634]: </domainsnapshot>
Nov 15 18:39:02 user nova-compute[75634]:  {{(pid=75634) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] Lazy-loading 'system_metadata' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:39:02 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     rv = execute(f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     six.reraise(c, e, tb)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     raise value
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     rv = meth(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     self._volume_snapshot_create(context, instance, guest,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     rv = execute(f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     six.reraise(c, e, tb)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     raise value
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     rv = meth(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] 
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-160008c8-980e-4340-97e3-250ba2f82d64 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] volume_snapshot_delete: delete_info: {'volume_id': '6b05c39d-d30e-42dd-beba-9b2d2c8d445a'} {{(pid=75634) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [None req-160008c8-980e-4340-97e3-250ba2f82d64 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf]     if delete_info['type'] != 'qcow2':
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] KeyError: 'type'
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [instance: dca2e952-fba6-40b7-8952-5524606cebaf] 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d662b8d5-5620-40ad-9836-f55ecf7cdcee could not be found.
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d662b8d5-5620-40ad-9836-f55ecf7cdcee could not be found. (HTTP 404) (Request-ID: req-cc5c207e-e86c-4ce3-9b12-c8c3cb784cc1)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d662b8d5-5620-40ad-9836-f55ecf7cdcee could not be found.
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server [None req-37fd2775-8564-4e55-8ae8-8748dd3d5e01 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver [None req-160008c8-980e-4340-97e3-250ba2f82d64 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-655254ce-0f2a-435e-92e0-354ecb2082fd)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 18:39:02 user nova-compute[75634]: ERROR nova.virt.libvirt.driver 
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server [None req-160008c8-980e-4340-97e3-250ba2f82d64 tempest-VolumesAssistedSnapshotsTest-156326989 tempest-VolumesAssistedSnapshotsTest-156326989-project] Exception during message handling: KeyError: 'type'
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 18:39:02 user nova-compute[75634]: ERROR oslo_messaging.rpc.server 
Nov 15 18:39:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:02 user nova-compute[75634]: INFO nova.compute.manager [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Detaching volume 6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:02 user nova-compute[75634]: INFO nova.virt.block_device [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Attempting to driver detach volume 6b05c39d-d30e-42dd-beba-9b2d2c8d445a from mountpoint /dev/vdb
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Attempting to detach device vdb from instance dca2e952-fba6-40b7-8952-5524606cebaf from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:02 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:02 user nova-compute[75634]:   <source dev="/dev/sdi"/>
Nov 15 18:39:02 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:02 user nova-compute[75634]:   <serial>6b05c39d-d30e-42dd-beba-9b2d2c8d445a</serial>
Nov 15 18:39:02 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:39:02 user nova-compute[75634]: </disk>
Nov 15 18:39:02 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:02 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Successfully detached device vdb from instance dca2e952-fba6-40b7-8952-5524606cebaf from the persistent domain config.
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dca2e952-fba6-40b7-8952-5524606cebaf from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:02 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:02 user nova-compute[75634]:   <source dev="/dev/sdi"/>
Nov 15 18:39:02 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:02 user nova-compute[75634]:   <serial>6b05c39d-d30e-42dd-beba-9b2d2c8d445a</serial>
Nov 15 18:39:02 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:39:02 user nova-compute[75634]: </disk>
Nov 15 18:39:02 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '5f723df4-d899-4ae0-9e5a-17470bf7f550', 'serial': '5f723df4-d899-4ae0-9e5a-17470bf7f550'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '39797443-60e1-48f7-920e-38569961079b'}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '39797443-60e1-48f7-920e-38569961079b', 'serial'} {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:03 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d8d616-30f7-47e7-96bf-4ab92d2deaec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:39:03 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0961d65-6d9e-4eab-ba3f-52d0c25f59ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550] added
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecca0631-63b9-4f5e-acac-8f095f6f9991]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d54751-f734-41d8-949f-2aee9f168366]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjckGLbA {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjckGLbA" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df647b-5f72-454a-a340-ce5b6f42d3c7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjckGLbA'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b547b64f-3f2f-42d6-8013-548b22553f91]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eeb9b1-2c86-44d4-9ba2-480e2eff3680]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae070789-2e76-4f97-97e9-0888dba989c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]
Nov 15 18:39:03 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a0406-7404-4b8e-9678-d8619409e8cb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9951a31e-32c8-4777-aa3e-a5554a22a9a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:03 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f46ab-d4ba-4219-9db2-712a5c6a0ab2]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:39:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 is timed out.
Nov 15 18:39:03 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully detached device vdb from instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 from the live domain config.
Nov 15 18:39:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnsbvtJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23961366637633638', 'path': '/dev/sdk'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366637633638', 'path': '/dev/sdk'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.836s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lazy-loading 'flavor' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.271s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d22a74-b313-43ac-92ec-4a99ff6b7573]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:04 user nova-compute[75634]: No targets found.
Nov 15 18:39:04 user nova-compute[75634]: iSNS:
Nov 15 18:39:04 user nova-compute[75634]: No targets found.
Nov 15 18:39:04 user nova-compute[75634]: STATIC:
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:04 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:04 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:04 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:04 user nova-compute[75634]: No targets found.
Nov 15 18:39:04 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:04 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:04 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[830de6b0-f2eb-48c4-9018-606cfb6fe3ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[281aad73-9552-470c-89b9-8d7f79dfbe4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:04 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:04 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b445892d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8e4093-9e2d-47c8-b23f-86aefc82ccf7]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e2526-2496-492f-b7cf-55e0ecaf18f8]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b90e323-5300-4001-ab3c-f11ffeba83ac]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0cc8fd-3ca7-4080-831f-b92c26b28c1d]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[33038cb8-7f26-4001-8412-c2f8768443e7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f1ae4-d692-455c-ab20-8a84aa6b084d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260]
Nov 15 18:39:05 user nova-compute[75634]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:05 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4eac55-20c3-41c0-903c-c5d297debd7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b04f15-6f43-4403-a8cc-799148b3316a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.615s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] <== disconnect_volume: return (1452ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:06 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'flavor' on Instance uuid fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f97a301f-2b8d-4a38-8d14-058f7251b58f tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.547s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 393216000 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 570425344 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-changed-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing instance network info cache due to event network-changed-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] Acquiring lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] Acquired lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Refreshing network info cache for port a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:39:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 696254464 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 784334848 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:08 user nova-compute[75634]: DEBUG nova.network.neutron [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updated VIF entry in instance network info cache for port a87933ae-11a4-4393-8eb2-2fe2f6d6aef3. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:39:08 user nova-compute[75634]: DEBUG nova.network.neutron [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a934af5d-588a-4f90-92ef-5f6a54e72cf1 req-87718590-306b-4733-84eb-995abce391b9 service nova] Releasing lock "refresh_cache-47112be8-147d-4f27-853c-d306ae4bfe19" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 872415232 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 943718400 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 1027604480 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:10 user nova-compute[75634]: INFO nova.compute.manager [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Terminating instance
Nov 15 18:39:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-9f96578b-017d-40e3-ab91-03a63a063621 req-0cdba7df-df16-450e-b7e4-7c58c7849827 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQoKGMnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '39797443-60e1-48f7-920e-38569961079b'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:11 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cc3b08-7eab-40a3-9e24-c60a27eb1019]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:11 user nova-compute[75634]: No targets found.
Nov 15 18:39:11 user nova-compute[75634]: iSNS:
Nov 15 18:39:11 user nova-compute[75634]: No targets found.
Nov 15 18:39:11 user nova-compute[75634]: STATIC:
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:11 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:11 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:11 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:11 user nova-compute[75634]: No targets found.
Nov 15 18:39:11 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:11 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:11 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[48abf2b0-2369-40ff-a64b-d3f56ba943f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d9c07a7-1e02-491b-a6c0-d7b9e7152b1e req-30a41880-16c7-4d73-9bc3-8455b0488da0 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e3f93-faed-4239-a321-550765f27a55]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b (non-flash)
Nov 15 18:39:11 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:11 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b444771c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b'): ({'sdh'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Removing single pathed devices sdh {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec6d33-2f1b-4e6d-8a24-6a4685820eb8]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb31e5f-1b11-4c89-b5d2-fe8522012346]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Flushing IO for device /dev/sdh {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2448d51-f54b-4a46-acdd-0c7d1801cebe]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8a74d-f215-42fc-8237-b2b48293b188]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2d94c-8890-4e64-9c61-198313fa4f69]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-da5c93bf-79d7-40ff-8026-12474b62fa36 req-24302ca4-8e47-4d1f-b662-aca28a3d8952 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[532304c2-9353-4087-81a9-7cbfd098e0ed]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260]
Nov 15 18:39:11 user nova-compute[75634]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:11 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39797443-60e1-48f7-920e-38569961079b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[32263edb-7d69-4ffa-9c4e-89c4b9ebdd7e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] <== disconnect_volume: return (490ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e', 'attached_at': '', 'detached_at': '', 'volume_id': '5f723df4-d899-4ae0-9e5a-17470bf7f550', 'serial'} {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: removing Cinder connection for volume 39797443-60e1-48f7-920e-38569961079b {{(pid=75634) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Instance destroyed successfully.
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.objects.instance [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lazy-loading 'resources' on Instance uuid 47112be8-147d-4f27-853c-d306ae4bfe19 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa87933ae-11, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a63322af-e5b9-4d15-a5c4-e66fcefd33c4) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:ba,bridge_name='br-int',has_traffic_filtering=True,id=a87933ae-11a4-4393-8eb2-2fe2f6d6aef3,network=Network(fcb87596-23c3-4021-b001-5ba381e159b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87933ae-11')
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf38851-4a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] swap_volume: Updating volume 39797443-60e1-48f7-920e-38569961079b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KjckGLbA", "auth_password": "pKn1cthmelbaxq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "5f723df4-d899-4ae0-9e5a-17470bf7f550"}, "status": "reserved", "instance": "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e", "attached_at": "", "detached_at": "", "volume_id": "5f723df4-d899-4ae0-9e5a-17470bf7f550", "serial": "5f723df4-d899-4ae0-9e5a-17470bf7f550"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5f723df4-d899-4ae0-9e5a-17470bf7f550', 'no_device': None, 'attachment_id': '28bf93ca-e22a-4751-b495-dcef6b1776e3'} {{(pid=75634) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cab16bca-8efb-459f-b629-aa9af04158e2 tempest-TestVolumeSwap-586952912 tempest-TestVolumeSwap-586952912-project-admin] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.042s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a87369f-20ae-43df-b087-24b07f4401dd) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=0cf38851-4aaf-472d-bca7-039d3c78eb05,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0cf38851-4a')
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0417467e-87, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=263966a8-eb4f-4281-90b5-702d3a59d135) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=0417467e-87d7-42e9-be85-1de345e580b7,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0417467e-87')
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "address": "fa:16:3e:42:c0:a6", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac230d3-62", "ovs_interfaceid": "fac230d3-6259-46c2-ad96-d62bc5ee2a50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac230d3-62, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6a5249a-479b-4abb-a10f-72f1ce987b21) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c0:a6,bridge_name='br-int',has_traffic_filtering=True,id=fac230d3-6259-46c2-ad96-d62bc5ee2a50,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac230d3-62')
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf97f8b-68, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86442ec1-7d9f-40cd-9d33-5930bbb4972e) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=fcf97f8b-6858-4ae5-acc1-bc41ffee7126,network=Network(c1237f39-65ab-45ab-bd5e-6b9b2a6ed484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf97f8b-68')
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d6682b8-f3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-a2fce040-a3de-4ae6-81a1-8e930e645afe for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-389dc989-bb1c-4762-ab00-e39bc108041f req-e15847ea-5b52-4be2-a1a9-6e39f36ccc27 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-a2fce040-a3de-4ae6-81a1-8e930e645afe for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6115a5b-28be-429a-a784-132aa5a582c7) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b2:af,bridge_name='br-int',has_traffic_filtering=True,id=8d6682b8-f366-4f2c-99ff-83c006b8c4e8,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6682b8-f3')
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1507602507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1507602507',id=11,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn5Fob9MirZF/wgOHCFp1fJKrszHiKXKVz5H/iDoe5K/jK0RVj/Bq9lAEhpi20NwZAWmVAb8DCcXEirp7ZsRawxUIRWIyKxzWdMmPoiYz/ll47Jxll7ZckbImpOuUN3eg==',key_name='tempest-keypair-1555980932',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5692c579c294988b628dd2c27fbc303',ramdisk_id='',reservation_id='r-3nh0lga5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-793619391',owner_user_name='tempest-TaggedBootDevicesTest_v242-793619391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c472d7cb7dc4ea2bf629f476397df98',uuid=47112be8-147d-4f27-853c-d306ae4bfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converting VIF {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2fce040-a3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0985f846-76d6-42a7-8a03-f02098ff9dbe) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:13 user nova-compute[75634]: INFO os_vif [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:98,bridge_name='br-int',has_traffic_filtering=True,id=a2fce040-a3de-4ae6-81a1-8e930e645afe,network=Network(8da69755-8333-4d43-ba98-6535447d9f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fce040-a3')
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGQaoUhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d610d64-ae04-4dde-a3e3-98249bcdbab4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]: iSNS:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]: STATIC:
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:13 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:13 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50877e02-11cb-4275-93bc-709cf86a8750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0cf38851-4aaf-472d-bca7-039d3c78eb05 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-unplugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-unplugged-0417467e-87d7-42e9-be85-1de345e580b7 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-272aba9d-92fe-42a0-bbfb-8360516baad0 req-f7039d9c-a396-4425-b578-dd1f71edcfd7 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-0417467e-87d7-42e9-be85-1de345e580b7 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dae97bb-59aa-441c-b687-bd04a6cbd493]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68295ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: INFO nova.compute.manager [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Detaching volume 5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1941b-009d-4fb1-880a-0b7abc685c66]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ea04e-2b78-41b4-bd1b-9201102ec91e]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0f04b-6bf3-44d5-b00b-bd3a52080b8c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: INFO nova.virt.block_device [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Attempting to driver detach volume 5f723df4-d899-4ae0-9e5a-17470bf7f550 from mountpoint /dev/vdb
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Attempting to detach device vdb from instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:13 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:13 user nova-compute[75634]:   <source dev="/dev/sdk"/>
Nov 15 18:39:13 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:13 user nova-compute[75634]:   <serial>5f723df4-d899-4ae0-9e5a-17470bf7f550</serial>
Nov 15 18:39:13 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:39:13 user nova-compute[75634]: </disk>
Nov 15 18:39:13 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 req-de81a229-356c-4a3d-b217-213238713114 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event volume-reimaged-d1688aff-0b69-4d67-85ac-a78bb49f11a0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 req-de81a229-356c-4a3d-b217-213238713114 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 req-de81a229-356c-4a3d-b217-213238713114 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 req-de81a229-356c-4a3d-b217-213238713114 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 req-de81a229-356c-4a3d-b217-213238713114 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Processing event volume-reimaged-d1688aff-0b69-4d67-85ac-a78bb49f11a0 {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e35fb-30f3-480b-834a-01d00ac61db5]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b2bcb-206f-441a-ae13-98b5c374504d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] Acquiring lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] Lock "47112be8-147d-4f27-853c-d306ae4bfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] No waiting events found dispatching network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING nova.compute.manager [req-93d0fd3f-7fd7-4475-b207-9a14f1808236 req-5efb428c-45f5-43d1-9a15-7e3bb02ebf23 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received unexpected event network-vif-plugged-fac230d3-6259-46c2-ad96-d62bc5ee2a50 for instance with vm_state active and task_state deleting.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9c22c-f6ad-47d4-8f78-2cdcdc9cfab4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260]
Nov 15 18:39:13 user nova-compute[75634]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Successfully detached device vdb from instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e from the persistent domain config.
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:39:13 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:13 user nova-compute[75634]:   <source dev="/dev/sdk"/>
Nov 15 18:39:13 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:13 user nova-compute[75634]:   <serial>5f723df4-d899-4ae0-9e5a-17470bf7f550</serial>
Nov 15 18:39:13 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:39:13 user nova-compute[75634]: </disk>
Nov 15 18:39:13 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873c57e5-2aae-45a1-bb08-86e58c66cc55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb445110-32b9-428d-afc5-1f054880a02c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== disconnect_volume: return (348ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AikfSWIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[60309bee-27b5-4252-90ab-76df2faab060]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]: iSNS:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]: STATIC:
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:13 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:13 user nova-compute[75634]: No targets found.
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:13 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:13 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: INFO nova.virt.block_device [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Booting with volume d1688aff-0b69-4d67-85ac-a78bb49f11a0 at /dev/vda
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39d31e-e0ad-403b-899d-06faedcc8745]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5469d2-e758-4ecb-9d1d-8cdfc9fd613c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4452e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.utils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb7ed2c-7b58-402f-89ec-4acd6f0b7986]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd64c02-23e6-426a-9b1f-a6c6fe3dd00a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[363da487-60e5-4cfb-9a03-01ee81a453bd]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594488d-a0a6-4a0e-a0cb-72a0a270b6b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0439f3-5086-4383-88af-079c33082747]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0abf5-ccb2-421a-9d6b-98b23255f5be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e9441-69b4-44f3-a94f-1e4c2a17ed31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd016f9-bfa6-4da5-8a9b-1f6b02bbda79]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a9bc4-569d-427d-9e45-6fd7ff369f8a]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.utils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating existing volume attachment record: 0de64bc4-c92b-4b49-90de-71845dd1c139 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd85497f-e2ff-4742-9628-799e9c96161d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f0e65-bf8f-4c0b-ad80-c45596c81899]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260]
Nov 15 18:39:13 user nova-compute[75634]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8905ff-295f-4f74-8824-8da2aba13e09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d459fbed-d52d-4bb1-ada5-85291ea3f963]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== disconnect_volume: return (378ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTNutOcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807861c-b217-4a7d-ab4c-3154b65bd4cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:14 user nova-compute[75634]: No targets found.
Nov 15 18:39:14 user nova-compute[75634]: iSNS:
Nov 15 18:39:14 user nova-compute[75634]: No targets found.
Nov 15 18:39:14 user nova-compute[75634]: STATIC:
Nov 15 18:39:14 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:14 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:14 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:14 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:14 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:14 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:14 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d
Nov 15 18:39:14 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:14 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:14 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:14 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:14 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:14 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:14 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:14 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:14 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:14 user nova-compute[75634]: No targets found.
Nov 15 18:39:14 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:14 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:14 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcad702-7c8d-4611-817f-75c46ded5335]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb104e4-640d-4a8a-8229-463eb7af625e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d (non-flash)
Nov 15 18:39:14 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:14 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b681063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874bdc1-3e49-4715-8eb8-a94ae8922454]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b644b-e772-434a-aa8a-f143a5a9fb16]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b92046-6344-4dd7-9a01-1a98b693aac3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d028383-8cca-40de-bd42-5b4120ef4a0e]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ce583-ac50-4bf3-8266-67bc55f61f51]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0863e88f-5cb9-4d48-9376-a189df789a9e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260]
Nov 15 18:39:14 user nova-compute[75634]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:14 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cf6fe1-b728-4d7a-b3d8-85f429865b0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d4029-b0c3-4bc4-ab27-8d35d2578dd2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] <== disconnect_volume: return (336ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Deleting instance files /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19_del
Nov 15 18:39:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Deletion of /opt/stack/data/nova/instances/47112be8-147d-4f27-853c-d306ae4bfe19_del complete
Nov 15 18:39:14 user nova-compute[75634]: INFO nova.compute.manager [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Took 3.70 seconds to destroy the instance on the hypervisor.
Nov 15 18:39:14 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:39:14 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:39:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3a64d7e-5a16-45ee-a51e-df286336e5ee req-c20c3137-9894-46b7-9310-027ac8c26ae9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-deleted-fac230d3-6259-46c2-ad96-d62bc5ee2a50 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:16 user nova-compute[75634]: INFO nova.compute.manager [req-e3a64d7e-5a16-45ee-a51e-df286336e5ee req-c20c3137-9894-46b7-9310-027ac8c26ae9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Neutron deleted interface fac230d3-6259-46c2-ad96-d62bc5ee2a50; detaching it from the instance and deleting it from the info cache
Nov 15 18:39:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-e3a64d7e-5a16-45ee-a51e-df286336e5ee req-c20c3137-9894-46b7-9310-027ac8c26ae9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [{"id": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "address": "fa:16:3e:bf:cc:ba", "network": {"id": "fcb87596-23c3-4021-b001-5ba381e159b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1894624418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87933ae-11", "ovs_interfaceid": "a87933ae-11a4-4393-8eb2-2fe2f6d6aef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "address": "fa:16:3e:63:9f:bf", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf38851-4a", "ovs_interfaceid": "0cf38851-4aaf-472d-bca7-039d3c78eb05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0417467e-87d7-42e9-be85-1de345e580b7", "address": "fa:16:3e:27:4c:5a", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417467e-87", "ovs_interfaceid": "0417467e-87d7-42e9-be85-1de345e580b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "address": "fa:16:3e:8e:0f:5d", "network": {"id": "c1237f39-65ab-45ab-bd5e-6b9b2a6ed484", "bridge": "br-int", "label": "tempest-device-tagging-net1-533472534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf97f8b-68", "ovs_interfaceid": "fcf97f8b-6858-4ae5-acc1-bc41ffee7126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "address": "fa:16:3e:97:b2:af", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6682b8-f3", "ovs_interfaceid": "8d6682b8-f366-4f2c-99ff-83c006b8c4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "address": "fa:16:3e:15:2a:98", "network": {"id": "8da69755-8333-4d43-ba98-6535447d9f79", "bridge": "br-int", "label": "tempest-device-tagging-net2-1131207088", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5692c579c294988b628dd2c27fbc303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fce040-a3", "ovs_interfaceid": "a2fce040-a3de-4ae6-81a1-8e930e645afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3a64d7e-5a16-45ee-a51e-df286336e5ee req-c20c3137-9894-46b7-9310-027ac8c26ae9 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Detach interface failed, port_id=fac230d3-6259-46c2-ad96-d62bc5ee2a50, reason: Instance 47112be8-147d-4f27-853c-d306ae4bfe19 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:17 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:18 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Took 3.64 seconds to deallocate network for instance.
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 is timed out.
Nov 15 18:39:18 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Successfully detached device sdc from instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 from the live domain config.
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlUOynow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:18 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6e85de-ca47-4f4d-9f26-6e8d1ec6fb09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-c68d5ad6-f597-4a5d-a726-06f94a651d0c req-df6011ba-8538-40b6-bc8a-3b3c21e92608 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-deleted-a2fce040-a3de-4ae6-81a1-8e930e645afe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-c68d5ad6-f597-4a5d-a726-06f94a651d0c req-df6011ba-8538-40b6-bc8a-3b3c21e92608 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-deleted-a87933ae-11a4-4393-8eb2-2fe2f6d6aef3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-c68d5ad6-f597-4a5d-a726-06f94a651d0c req-df6011ba-8538-40b6-bc8a-3b3c21e92608 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-deleted-fcf97f8b-6858-4ae5-acc1-bc41ffee7126 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-c68d5ad6-f597-4a5d-a726-06f94a651d0c req-df6011ba-8538-40b6-bc8a-3b3c21e92608 service nova] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Received event network-vif-deleted-8d6682b8-f366-4f2c-99ff-83c006b8c4e8 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:18 user nova-compute[75634]: No targets found.
Nov 15 18:39:18 user nova-compute[75634]: iSNS:
Nov 15 18:39:18 user nova-compute[75634]: No targets found.
Nov 15 18:39:18 user nova-compute[75634]: STATIC:
Nov 15 18:39:18 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:18 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:18 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:18 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:18 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:18 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:18 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:18 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:18 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:18 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7
Nov 15 18:39:18 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:18 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:18 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:18 user nova-compute[75634]: No targets found.
Nov 15 18:39:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:18 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:18 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a3cfc-825d-463f-b2a7-9e7ca2ac21f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[02453ac9-937e-4ed6-8862-56234fa5264a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 (non-flash)
Nov 15 18:39:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4458a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be5d11-14a3-45e0-932c-4706bec9790d]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dc026-135b-46ff-875c-23b43cb75804]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bbb222-734e-4c67-9b53-d0ede822fd77]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c82f7-c2dc-45ec-910c-edd09f7a8757]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd73b45-e7c1-4508-9cf1-14195781e908]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddb8502-9042-4cbc-a3d0-eff1c1644487]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260]
Nov 15 18:39:18 user nova-compute[75634]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:958826d5-642a-4934-954d-bf238d6950a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b059b4b-8d59-4d11-8cdb-132f8eaea1d5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] <== disconnect_volume: return (370ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:39:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Creating image(s)
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Ensure instance console log exists: /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start _get_guest_xml network_info=[{"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65848bf6-8074-4bab-804c-342f3edcc0cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1688aff-0b69-4d67-85ac-a78bb49f11a0', 'serial': 'd1688aff-0b69-4d67-85ac-a78bb49f11a0'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '0de64bc4-c92b-4b49-90de-71845dd1c139', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:39:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 18:39:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65848bf6-8074-4bab-804c-342f3edcc0cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:19 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:19 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:19 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d6f37-fa38-4f35-af05-e41faaef5c0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:39:19 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5050c81c-a97e-443e-a4bf-08943902053c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0] added
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fed2a8-4f4b-49a1-a2a8-8463460af9f2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lazy-loading 'flavor' on Instance uuid db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[830016b2-990c-4584-8979-adff9c788170]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwUvDiFj {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwUvDiFj" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ebac5-e36b-4911-998e-d9b985d03b42]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwUvDiFj'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c615cda7-d99e-4ec3-a521-b2e0739567a0 tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6e9d9-87db-41c7-9885-f820d8e47b4d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[39020637-5011-4fd2-8da7-cb9f0fdab08e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ee116-f973-42cd-8866-95a19235af02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]
Nov 15 18:39:19 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6918a7d4-49d2-404f-aa8e-1c05f87b3353]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ff665-fd73-4e70-9565-e9fbbf00fa9a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57e760-bd57-40c4-8e86-0e3a801d4c28]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:39:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.418s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:20 user nova-compute[75634]: INFO nova.compute.manager [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] [instance: 47112be8-147d-4f27-853c-d306ae4bfe19] Took 2.65 seconds to detach 3 volumes for instance.
Nov 15 18:39:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23663323163623461', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663323163623461', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-915106744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:39:21 user nova-compute[75634]:   <uuid>65848bf6-8074-4bab-804c-342f3edcc0cc</uuid>
Nov 15 18:39:21 user nova-compute[75634]:   <name>instance-00000009</name>
Nov 15 18:39:21 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:39:21 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:39:21 user nova-compute[75634]:   <metadata>
Nov 15 18:39:21 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:21 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:39:21 user nova-compute[75634]:       <nova:name>tempest-ServerActionsV293TestJSON-server-915106744</nova:name>
Nov 15 18:39:21 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:39:19</nova:creationTime>
Nov 15 18:39:21 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:39:21 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:21 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:39:21 user nova-compute[75634]:       <nova:owner>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:user uuid="1ddac01d950041a99517eed7b12d02bb">tempest-ServerActionsV293TestJSON-1306189062-project-member</nova:user>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:project uuid="70b00f11d8394be995ee987ac4f9fbaf">tempest-ServerActionsV293TestJSON-1306189062</nova:project>
Nov 15 18:39:21 user nova-compute[75634]:       </nova:owner>
Nov 15 18:39:21 user nova-compute[75634]:       <nova:ports>
Nov 15 18:39:21 user nova-compute[75634]:         <nova:port uuid="5d3caf5f-9f37-4a79-abe5-c26c67dc074c">
Nov 15 18:39:21 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:39:21 user nova-compute[75634]:         </nova:port>
Nov 15 18:39:21 user nova-compute[75634]:       </nova:ports>
Nov 15 18:39:21 user nova-compute[75634]:     </nova:instance>
Nov 15 18:39:21 user nova-compute[75634]:   </metadata>
Nov 15 18:39:21 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:39:21 user nova-compute[75634]:     <system>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="serial">65848bf6-8074-4bab-804c-342f3edcc0cc</entry>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="uuid">65848bf6-8074-4bab-804c-342f3edcc0cc</entry>
Nov 15 18:39:21 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:39:21 user nova-compute[75634]:     </system>
Nov 15 18:39:21 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:21 user nova-compute[75634]:   <os>
Nov 15 18:39:21 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:39:21 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:39:21 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:39:21 user nova-compute[75634]:   </os>
Nov 15 18:39:21 user nova-compute[75634]:   <features>
Nov 15 18:39:21 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:21 user nova-compute[75634]:     <apic/>
Nov 15 18:39:21 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:39:21 user nova-compute[75634]:   </features>
Nov 15 18:39:21 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:39:21 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:39:21 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:39:21 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:39:21 user nova-compute[75634]:   </clock>
Nov 15 18:39:21 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:39:21 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:39:21 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:39:21 user nova-compute[75634]:   </cpu>
Nov 15 18:39:21 user nova-compute[75634]:   <devices>
Nov 15 18:39:21 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:39:21 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:21 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 18:39:21 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:39:21 user nova-compute[75634]:       <serial>d1688aff-0b69-4d67-85ac-a78bb49f11a0</serial>
Nov 15 18:39:21 user nova-compute[75634]:     </disk>
Nov 15 18:39:21 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:39:21 user nova-compute[75634]:       <mac address="fa:16:3e:f5:32:32"/>
Nov 15 18:39:21 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:39:21 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:39:21 user nova-compute[75634]:       <target dev="tap5d3caf5f-9f"/>
Nov 15 18:39:21 user nova-compute[75634]:     </interface>
Nov 15 18:39:21 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:39:21 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc/console.log" append="off"/>
Nov 15 18:39:21 user nova-compute[75634]:     </serial>
Nov 15 18:39:21 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:39:21 user nova-compute[75634]:     <video>
Nov 15 18:39:21 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:39:21 user nova-compute[75634]:     </video>
Nov 15 18:39:21 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:39:21 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:39:21 user nova-compute[75634]:     </rng>
Nov 15 18:39:21 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:39:21 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:39:21 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:39:21 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:21 user nova-compute[75634]:   </devices>
Nov 15 18:39:21 user nova-compute[75634]: </domain>
Nov 15 18:39:21 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-915106744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG os_vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e29899cc-8d45-5380-96d7-7ef6acdf7ab4', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d3caf5f-9f, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d3caf5f-9f, col_values=(('qos', UUID('196100c5-d56b-4bf0-aed4-358cc53c6c77')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d3caf5f-9f, col_values=(('external_ids', {'iface-id': '5d3caf5f-9f37-4a79-abe5-c26c67dc074c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:32:32', 'vm-uuid': '65848bf6-8074-4bab-804c-342f3edcc0cc'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: INFO os_vif [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f')
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] No VIF found with MAC fa:16:3e:f5:32:32, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:21 user nova-compute[75634]: INFO nova.compute.manager [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Terminating instance
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-unplugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] No waiting events found dispatching network-vif-unplugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-f3bfe5f4-0f1a-4316-b585-db3fe3272bf0 req-32e4a96f-54f4-4f92-b7bc-4ce0da664b1a service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-unplugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:21 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Deleted allocations for instance 47112be8-147d-4f27-853c-d306ae4bfe19
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-da51c540-afdb-482c-a709-d106fcb0526c tempest-TaggedBootDevicesTest_v242-793619391 tempest-TaggedBootDevicesTest_v242-793619391-project-member] Lock "47112be8-147d-4f27-853c-d306ae4bfe19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.289s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 is timed out.
Nov 15 18:39:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully detached device vdb from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the live domain config.
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtAbDFuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:22 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[16879970-8251-41cd-ab18-3d01f6aa2176]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:22 user nova-compute[75634]: No targets found.
Nov 15 18:39:22 user nova-compute[75634]: iSNS:
Nov 15 18:39:22 user nova-compute[75634]: No targets found.
Nov 15 18:39:22 user nova-compute[75634]: STATIC:
Nov 15 18:39:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914
Nov 15 18:39:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:39:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:22 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:22 user nova-compute[75634]: No targets found.
Nov 15 18:39:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:22 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:22 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf99da6-14bc-40c4-9a85-213d37addd5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9512853e-d4f1-4d26-a378-49a4c1b60a51]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44312c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f460b3-52d8-4e77-8c86-90a89f8b5c84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f3a002-100e-4921-ba0d-c66d63c376b6]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[118600b7-ebf1-44e8-896a-b049c22b4586]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1748875d-ab8e-4eea-9708-022b3e8a82c8]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5261c9-7849-4c5f-88df-90453681644e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ef124f-4eb1-431c-a97d-af0e5530f0ec]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260]
Nov 15 18:39:22 user nova-compute[75634]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1efd5bdd-4c37-4050-b603-629e38a5c914 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae53bcd1-4571-4d6b-9add-605f60182e26]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] <== disconnect_volume: return (323ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Instance destroyed successfully.
Nov 15 18:39:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lazy-loading 'resources' on Instance uuid db30cd06-6f39-4ee8-b229-cfa071a0ef88 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.objects.instance [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1372928701',display_name='tempest-AttachSCSIVolumeTestJSON-server-1372928701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1372928701',id=8,image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAgDfLZ7BR2H8VmF/vECfuTgLODE3eLfGXfTWTs4yq4/gsQqN5AM3VrCeLRH3A4Fk9wJV9g5bObkf+ZIPxcDjj4KTBjNt9nETd25M2io1Ve/CBS+UWRtO4ObzjCQKUpIQ==',key_name='tempest-keypair-342561368',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90fa379a4301426998176df23feda180',ramdisk_id='',reservation_id='r-fhppxnuf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fcb6c264-52bf-42bc-8eaf-01300f6d70c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1982087370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1982087370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e1a64114ef94c81b3592a30d8418aa1',uuid=db30cd06-6f39-4ee8-b229-cfa071a0ef88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converting VIF {"id": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "address": "fa:16:3e:7b:80:82", "network": {"id": "2d7d2794-851a-496a-9580-83cf023d1c3b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-557828398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fa379a4301426998176df23feda180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5afcc93-c4", "ovs_interfaceid": "d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_vif [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dca2e952-fba6-40b7-8952-5524606cebaf is timed out.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.compute.manager [req-88130333-a982-4c01-8f53-655b148af55b req-2eec027e-6e77-4337-9c3b-eaf0194ba227 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state rebuild_spawning.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] Acquiring lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] No waiting events found dispatching network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.compute.manager [req-fab24936-0ffc-489d-a68a-eace6591299b req-1d7d3ca4-3f34-4f48-a943-896711946269 service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received unexpected event network-vif-plugged-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 for instance with vm_state active and task_state deleting.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Successfully detached device vdb from instance dca2e952-fba6-40b7-8952-5524606cebaf from the live domain config.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5afcc93-c4, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-65176b8f-69c0-4f65-86b5-4a895e7ed34f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-65176b8f-69c0-4f65-86b5-4a895e7ed34f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.compute.manager [req-175efb35-e0b9-402a-a126-ca0beb13f61f req-b307d790-0bbf-44a7-a522-884ac9195eeb service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state rebuild_spawning.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2573ddd8-5d6c-41bd-938e-5217fe6d78b9) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcorDekC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance spawned successfully.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:39:25 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7033MB free_disk=25.361492156982422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:25 user nova-compute[75634]: INFO os_vif [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:80:82,bridge_name='br-int',has_traffic_filtering=True,id=d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939,network=Network(2d7d2794-851a-496a-9580-83cf023d1c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5afcc93-c4')
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Deleting instance files /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88_del
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Deletion of /opt/stack/data/nova/instances/db30cd06-6f39-4ee8-b229-cfa071a0ef88_del complete
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[42358a52-17a2-4ed7-b86e-d21d05e00037]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:25 user nova-compute[75634]: No targets found.
Nov 15 18:39:25 user nova-compute[75634]: iSNS:
Nov 15 18:39:25 user nova-compute[75634]: No targets found.
Nov 15 18:39:25 user nova-compute[75634]: STATIC:
Nov 15 18:39:25 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:25 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:25 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:25 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:39:25 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:25 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:25 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a
Nov 15 18:39:25 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:25 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:25 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:25 user nova-compute[75634]: No targets found.
Nov 15 18:39:25 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:25 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:25 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-550f351c-f296-4285-8e26-f8bff19bce8b tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.857s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b742f0-0e3b-4518-a917-89886b0dc9b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Attempting to detach device tap65176b8f-69 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] detach device xml: <interface type="ethernet">
Nov 15 18:39:25 user nova-compute[75634]:   <mac address="fa:16:3e:84:ab:99"/>
Nov 15 18:39:25 user nova-compute[75634]:   <model type="virtio"/>
Nov 15 18:39:25 user nova-compute[75634]:   <mtu size="1442"/>
Nov 15 18:39:25 user nova-compute[75634]:   <target dev="tap65176b8f-69"/>
Nov 15 18:39:25 user nova-compute[75634]: </interface>
Nov 15 18:39:25 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 18:39:25 user nova-compute[75634]:   <name>instance-00000007</name>
Nov 15 18:39:25 user nova-compute[75634]:   <uuid>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</uuid>
Nov 15 18:39:25 user nova-compute[75634]:   <metadata>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:25 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:38:45</nova:creationTime>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:25 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:25 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:25 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:25 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:25 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:25 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:25 user nova-compute[75634]:     <nova:port uuid="65176b8f-69c0-4f65-86b5-4a895e7ed34f">
Nov 15 18:39:25 user nova-compute[75634]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Nov 15 18:39:25 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:25 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:25 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:25 user nova-compute[75634]:   </metadata>
Nov 15 18:39:25 user nova-compute[75634]:   <memory unit='KiB'>524288</memory>
Nov 15 18:39:25 user nova-compute[75634]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 18:39:25 user nova-compute[75634]:   <vcpu placement='static'>1</vcpu>
Nov 15 18:39:25 user nova-compute[75634]:   <resource>
Nov 15 18:39:25 user nova-compute[75634]:     <partition>/machine</partition>
Nov 15 18:39:25 user nova-compute[75634]:   </resource>
Nov 15 18:39:25 user nova-compute[75634]:   <sysinfo type='smbios'>
Nov 15 18:39:25 user nova-compute[75634]:     <system>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='version'>0.0.0</entry>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='serial'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='uuid'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:25 user nova-compute[75634]:       <entry name='family'>Virtual Machine</entry>
Nov 15 18:39:25 user nova-compute[75634]:     </system>
Nov 15 18:39:25 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:25 user nova-compute[75634]:   <os>
Nov 15 18:39:25 user nova-compute[75634]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 18:39:25 user nova-compute[75634]:     <boot dev='hd'/>
Nov 15 18:39:25 user nova-compute[75634]:     <smbios mode='sysinfo'/>
Nov 15 18:39:25 user nova-compute[75634]:   </os>
Nov 15 18:39:25 user nova-compute[75634]:   <features>
Nov 15 18:39:25 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:25 user nova-compute[75634]:     <apic/>
Nov 15 18:39:25 user nova-compute[75634]:     <vmcoreinfo state='on'/>
Nov 15 18:39:25 user nova-compute[75634]:   </features>
Nov 15 18:39:25 user nova-compute[75634]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 18:39:25 user nova-compute[75634]:     <model fallback='forbid'>Nehalem</model>
Nov 15 18:39:25 user nova-compute[75634]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 18:39:25 user nova-compute[75634]:     <feature policy='require' name='vme'/>
Nov 15 18:39:25 user nova-compute[75634]:     <feature policy='require' name='x2apic'/>
Nov 15 18:39:25 user nova-compute[75634]:     <feature policy='require' name='hypervisor'/>
Nov 15 18:39:25 user nova-compute[75634]:   </cpu>
Nov 15 18:39:25 user nova-compute[75634]:   <clock offset='utc'>
Nov 15 18:39:25 user nova-compute[75634]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 18:39:25 user nova-compute[75634]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 18:39:25 user nova-compute[75634]:     <timer name='hpet' present='no'/>
Nov 15 18:39:25 user nova-compute[75634]:   </clock>
Nov 15 18:39:25 user nova-compute[75634]:   <on_poweroff>destroy</on_poweroff>
Nov 15 18:39:25 user nova-compute[75634]:   <on_reboot>restart</on_reboot>
Nov 15 18:39:25 user nova-compute[75634]:   <on_crash>destroy</on_crash>
Nov 15 18:39:25 user nova-compute[75634]:   <devices>
Nov 15 18:39:25 user nova-compute[75634]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 18:39:25 user nova-compute[75634]:     <disk type='file' device='disk'>
Nov 15 18:39:25 user nova-compute[75634]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 18:39:25 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk' index='2'/>
Nov 15 18:39:25 user nova-compute[75634]:       <backingStore type='file' index='3'>
Nov 15 18:39:25 user nova-compute[75634]:         <format type='raw'/>
Nov 15 18:39:25 user nova-compute[75634]:         <source file='/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9'/>
Nov 15 18:39:25 user nova-compute[75634]:         <backingStore/>
Nov 15 18:39:25 user nova-compute[75634]:       </backingStore>
Nov 15 18:39:25 user nova-compute[75634]:       <target dev='vda' bus='virtio'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='virtio-disk0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </disk>
Nov 15 18:39:25 user nova-compute[75634]:     <disk type='file' device='cdrom'>
Nov 15 18:39:25 user nova-compute[75634]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 18:39:25 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config' index='1'/>
Nov 15 18:39:25 user nova-compute[75634]:       <backingStore/>
Nov 15 18:39:25 user nova-compute[75634]:       <target dev='hda' bus='ide'/>
Nov 15 18:39:25 user nova-compute[75634]:       <readonly/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='ide0-0-0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </disk>
Nov 15 18:39:25 user nova-compute[75634]:     <controller type='usb' index='0' model='none'>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='usb'/>
Nov 15 18:39:25 user nova-compute[75634]:     </controller>
Nov 15 18:39:25 user nova-compute[75634]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='pci.0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </controller>
Nov 15 18:39:25 user nova-compute[75634]:     <controller type='ide' index='0'>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='ide'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 18:39:25 user nova-compute[75634]:     </controller>
Nov 15 18:39:25 user nova-compute[75634]:     <interface type='ethernet'>
Nov 15 18:39:25 user nova-compute[75634]:       <mac address='fa:16:3e:28:4f:cf'/>
Nov 15 18:39:25 user nova-compute[75634]:       <target dev='tap1d52672f-2f'/>
Nov 15 18:39:25 user nova-compute[75634]:       <model type='virtio'/>
Nov 15 18:39:25 user nova-compute[75634]:       <mtu size='1442'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='net0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </interface>
Nov 15 18:39:25 user nova-compute[75634]:     <interface type='ethernet'>
Nov 15 18:39:25 user nova-compute[75634]:       <mac address='fa:16:3e:84:ab:99'/>
Nov 15 18:39:25 user nova-compute[75634]:       <target dev='tap65176b8f-69'/>
Nov 15 18:39:25 user nova-compute[75634]:       <model type='virtio'/>
Nov 15 18:39:25 user nova-compute[75634]:       <mtu size='1442'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='net1'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </interface>
Nov 15 18:39:25 user nova-compute[75634]:     <serial type='pty'>
Nov 15 18:39:25 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:25 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:25 user nova-compute[75634]:       <target type='isa-serial' port='0'>
Nov 15 18:39:25 user nova-compute[75634]:         <model name='isa-serial'/>
Nov 15 18:39:25 user nova-compute[75634]:       </target>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </serial>
Nov 15 18:39:25 user nova-compute[75634]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 18:39:25 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:25 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:25 user nova-compute[75634]:       <target type='serial' port='0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </console>
Nov 15 18:39:25 user nova-compute[75634]:     <input type='mouse' bus='ps2'>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='input0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </input>
Nov 15 18:39:25 user nova-compute[75634]:     <input type='keyboard' bus='ps2'>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='input1'/>
Nov 15 18:39:25 user nova-compute[75634]:     </input>
Nov 15 18:39:25 user nova-compute[75634]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 18:39:25 user nova-compute[75634]:       <listen type='address' address='0.0.0.0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </graphics>
Nov 15 18:39:25 user nova-compute[75634]:     <audio id='1' type='none'/>
Nov 15 18:39:25 user nova-compute[75634]:     <video>
Nov 15 18:39:25 user nova-compute[75634]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='video0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </video>
Nov 15 18:39:25 user nova-compute[75634]:     <memballoon model='virtio'>
Nov 15 18:39:25 user nova-compute[75634]:       <stats period='10'/>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='balloon0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:25 user nova-compute[75634]:     <rng model='virtio'>
Nov 15 18:39:25 user nova-compute[75634]:       <backend model='random'>/dev/urandom</backend>
Nov 15 18:39:25 user nova-compute[75634]:       <alias name='rng0'/>
Nov 15 18:39:25 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 18:39:25 user nova-compute[75634]:     </rng>
Nov 15 18:39:25 user nova-compute[75634]:   </devices>
Nov 15 18:39:25 user nova-compute[75634]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 18:39:25 user nova-compute[75634]:     <label>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</label>
Nov 15 18:39:25 user nova-compute[75634]:     <imagelabel>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</imagelabel>
Nov 15 18:39:25 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:25 user nova-compute[75634]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 18:39:25 user nova-compute[75634]:     <label>+64055:+108</label>
Nov 15 18:39:25 user nova-compute[75634]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 18:39:25 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:25 user nova-compute[75634]: </domain>
Nov 15 18:39:25 user nova-compute[75634]:  {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully detached device tap65176b8f-69 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the persistent domain config.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] (1/8): Attempting to detach device tap65176b8f-69 with device alias net1 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] detach device xml: <interface type="ethernet">
Nov 15 18:39:25 user nova-compute[75634]:   <mac address="fa:16:3e:84:ab:99"/>
Nov 15 18:39:25 user nova-compute[75634]:   <model type="virtio"/>
Nov 15 18:39:25 user nova-compute[75634]:   <mtu size="1442"/>
Nov 15 18:39:25 user nova-compute[75634]:   <target dev="tap65176b8f-69"/>
Nov 15 18:39:25 user nova-compute[75634]: </interface>
Nov 15 18:39:25 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0125e3-d31e-461e-bf59-7d54a3fd7ff1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:25 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:25 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:25 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a (non-flash)
Nov 15 18:39:25 user nova-compute[75634]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:25 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:25 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4431e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a'): ({'sdi'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Removing single pathed devices sdi {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f3bf8b-576f-4010-aa67-473e2ae8970f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:39:25 user nova-compute[75634]: INFO nova.compute.manager [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Took 4.05 seconds to destroy the instance on the hypervisor.
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a0fdde-a041-4f0a-8da1-f5c5cb26c4ca]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Flushing IO for device /dev/sdi {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057603d-6014-4a67-ad01-6e1e41fb74c0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db30cd06-6f39-4ee8-b229-cfa071a0ef88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 65848bf6-8074-4bab-804c-342f3edcc0cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dca2e952-fba6-40b7-8952-5524606cebaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 99fe65b6-b8ff-4ee7-9606-5a9b90260b48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76be55-20c0-437c-a886-3f124da113de]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] SCSI volumes sdi have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b391f87-c5b4-4574-9b67-92ec86213d75]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45929f2-a63c-49dc-8cc3-54dbadf3999a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260]
Nov 15 18:39:25 user nova-compute[75634]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:25 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Start waiting for the detach event from libvirt for device tap65176b8f-69 with device alias net1 for instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b05c39d-d30e-42dd-beba-9b2d2c8d445a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776ceb9-bbcc-40c9-898c-3fda9731336a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] <== disconnect_volume: return (441ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:39:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.442s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75634) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-unplugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-unplugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:26 user nova-compute[75634]: WARNING nova.compute.manager [req-11008b13-32b6-42a9-b693-3e701978ff73 req-5f6f0fe7-85ae-4b0e-9bba-e8c8d87cf479 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-unplugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f for instance with vm_state active and task_state None.
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d52f0ba3-b1e1-4c85-bfb1-fd8df99dda60 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:26 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Took 1.08 seconds to deallocate network for instance.
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lazy-loading 'flavor' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3038e7fe-c7f5-489f-be69-12e16fcbdc5b tempest-VolumesAssistedSnapshotsTest-817823247 tempest-VolumesAssistedSnapshotsTest-817823247-project-admin] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.406s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:39:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:27 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Deleted allocations for instance db30cd06-6f39-4ee8-b229-cfa071a0ef88
Nov 15 18:39:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-78d894ca-753c-45af-8bfb-74963cdfc49c tempest-AttachSCSIVolumeTestJSON-1982087370 tempest-AttachSCSIVolumeTestJSON-1982087370-project-member] Lock "db30cd06-6f39-4ee8-b229-cfa071a0ef88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.720s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:28 user nova-compute[75634]: WARNING nova.compute.manager [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-65176b8f-69c0-4f65-86b5-4a895e7ed34f for instance with vm_state active and task_state None.
Nov 15 18:39:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-84822fbf-dfe2-4b4c-a5b3-e7aa3f0af305 req-9f9fd83c-63ab-42d4-9819-0296fe34902d service nova] [instance: db30cd06-6f39-4ee8-b229-cfa071a0ef88] Received event network-vif-deleted-d5afcc93-c4e0-4eca-b3e2-3ac8ab3dd939 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:34 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e is timed out.
Nov 15 18:39:34 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Successfully detached device vdb from instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e from the live domain config.
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjckGLbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '5f723df4-d899-4ae0-9e5a-17470bf7f550'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:34 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b11e9e-8bb9-4d1c-8f45-4a9a240c4360]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:39:34 user nova-compute[75634]: No targets found.
Nov 15 18:39:34 user nova-compute[75634]: iSNS:
Nov 15 18:39:34 user nova-compute[75634]: No targets found.
Nov 15 18:39:34 user nova-compute[75634]: STATIC:
Nov 15 18:39:34 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550
Nov 15 18:39:34 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:34 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:34 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:39:34 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:39:34 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:39:34 user nova-compute[75634]: FIRMWARE:
Nov 15 18:39:34 user nova-compute[75634]: No targets found.
Nov 15 18:39:34 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:39:34 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:39:34 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002d5fb-1d76-4152-adc0-e6e3e4fc1637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da05bb3-f7e6-454f-b64e-b7889386c0a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:34 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:34 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 (non-flash)
Nov 15 18:39:34 user nova-compute[75634]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:34 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44588e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550'): ({'sdk'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Removing single pathed devices sdk {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6d0f9-25cc-4c19-9844-914c2c941626]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f4c8e-9c99-4965-81d4-202083664e1d]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Flushing IO for device /dev/sdk {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0137aad7-c339-42f3-b4bc-c4082dcf2b81]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240f7da-1aff-4c4c-88d6-31588f7fdf3f]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] SCSI volumes sdk have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96628daf-3b87-4d1d-989b-5307b03fbd3b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e3d51-ac0c-47d3-8b35-f82248b87fad]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260]
Nov 15 18:39:34 user nova-compute[75634]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:34 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f723df4-d899-4ae0-9e5a-17470bf7f550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1be249-7c4d-411f-89a5-d557426c194e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] <== disconnect_volume: return (312ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:39:34 user nova-compute[75634]: INFO nova.compute.claims [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Claim successful on node user
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:39:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:39:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lazy-loading 'flavor' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50069740-757e-4690-8df3-e17515168b26 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.policy [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a3dc42740164b32b830f419a10be05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3250b3723c8a4a1db318035e0a7477df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:39:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Creating image(s)
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "/opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "/opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Successfully created port: d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk 1073741824" returned: 0 in 0.061s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:39:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Cannot resize image /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Ensure instance console log exists: /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Successfully updated port: d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-changed-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Refreshing instance network info cache due to event network-changed-d69446d8-0a84-47bb-a13c-e64b6503153c. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] Acquiring lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] Acquired lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Refreshing network info cache for port d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.neutron [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3ef467e2-8edb-4dd2-874c-7efa84c215ee req-6186c639-af9e-4d31-b8e5-14aec0992352 service nova] Releasing lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquired lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Updating instance_info_cache with network_info: [{"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Releasing lock "refresh_cache-83ca85a5-8369-4eeb-8a85-e674c6ff3876" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance network_info: |[{"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Start _get_guest_xml network_info=[{"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:39:37 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:39:37 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2074663907',display_name='tempest-VolumesAdminNegativeTest-server-2074663907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2074663907',id=14,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-uqdmi6wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:39:35Z,user_data=None,user_id='3a3dc42740164b32b830f419a10be05e',uuid=83ca85a5-8369-4eeb-8a85-e674c6ff3876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.objects.instance [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ca85a5-8369-4eeb-8a85-e674c6ff3876 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:39:37 user nova-compute[75634]:   <uuid>83ca85a5-8369-4eeb-8a85-e674c6ff3876</uuid>
Nov 15 18:39:37 user nova-compute[75634]:   <name>instance-0000000e</name>
Nov 15 18:39:37 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:39:37 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:39:37 user nova-compute[75634]:   <metadata>
Nov 15 18:39:37 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:37 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2074663907</nova:name>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:39:37</nova:creationTime>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:39:37 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:37 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:owner>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:user uuid="3a3dc42740164b32b830f419a10be05e">tempest-VolumesAdminNegativeTest-671222403-project-member</nova:user>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:project uuid="3250b3723c8a4a1db318035e0a7477df">tempest-VolumesAdminNegativeTest-671222403</nova:project>
Nov 15 18:39:37 user nova-compute[75634]:       </nova:owner>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:37 user nova-compute[75634]:       <nova:ports>
Nov 15 18:39:37 user nova-compute[75634]:         <nova:port uuid="d69446d8-0a84-47bb-a13c-e64b6503153c">
Nov 15 18:39:37 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 18:39:37 user nova-compute[75634]:         </nova:port>
Nov 15 18:39:37 user nova-compute[75634]:       </nova:ports>
Nov 15 18:39:37 user nova-compute[75634]:     </nova:instance>
Nov 15 18:39:37 user nova-compute[75634]:   </metadata>
Nov 15 18:39:37 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:39:37 user nova-compute[75634]:     <system>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="serial">83ca85a5-8369-4eeb-8a85-e674c6ff3876</entry>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="uuid">83ca85a5-8369-4eeb-8a85-e674c6ff3876</entry>
Nov 15 18:39:37 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:39:37 user nova-compute[75634]:     </system>
Nov 15 18:39:37 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:37 user nova-compute[75634]:   <os>
Nov 15 18:39:37 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:39:37 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:39:37 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:39:37 user nova-compute[75634]:   </os>
Nov 15 18:39:37 user nova-compute[75634]:   <features>
Nov 15 18:39:37 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:37 user nova-compute[75634]:     <apic/>
Nov 15 18:39:37 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:39:37 user nova-compute[75634]:   </features>
Nov 15 18:39:37 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:39:37 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:39:37 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:39:37 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:39:37 user nova-compute[75634]:   </clock>
Nov 15 18:39:37 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:39:37 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:39:37 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:39:37 user nova-compute[75634]:   </cpu>
Nov 15 18:39:37 user nova-compute[75634]:   <devices>
Nov 15 18:39:37 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:39:37 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:39:37 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk"/>
Nov 15 18:39:37 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:39:37 user nova-compute[75634]:     </disk>
Nov 15 18:39:37 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:39:37 user nova-compute[75634]:       <mac address="fa:16:3e:9b:0f:7c"/>
Nov 15 18:39:37 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:39:37 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:39:37 user nova-compute[75634]:       <target dev="tapd69446d8-0a"/>
Nov 15 18:39:37 user nova-compute[75634]:     </interface>
Nov 15 18:39:37 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:39:37 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/console.log" append="off"/>
Nov 15 18:39:37 user nova-compute[75634]:     </serial>
Nov 15 18:39:37 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:39:37 user nova-compute[75634]:     <video>
Nov 15 18:39:37 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:39:37 user nova-compute[75634]:     </video>
Nov 15 18:39:37 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:39:37 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:39:37 user nova-compute[75634]:     </rng>
Nov 15 18:39:37 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:39:37 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:39:37 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:39:37 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:37 user nova-compute[75634]:   </devices>
Nov 15 18:39:37 user nova-compute[75634]: </domain>
Nov 15 18:39:37 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2074663907',display_name='tempest-VolumesAdminNegativeTest-server-2074663907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2074663907',id=14,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-uqdmi6wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:39:35Z,user_data=None,user_id='3a3dc42740164b32b830f419a10be05e',uuid=83ca85a5-8369-4eeb-8a85-e674c6ff3876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG os_vif [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dea0344f-3e0d-573b-9173-05b8f5e9e42c', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69446d8-0a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd69446d8-0a, col_values=(('qos', UUID('fc62021b-af00-44f3-bb17-8a0741cb5ee6')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd69446d8-0a, col_values=(('external_ids', {'iface-id': 'd69446d8-0a84-47bb-a13c-e64b6503153c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:0f:7c', 'vm-uuid': '83ca85a5-8369-4eeb-8a85-e674c6ff3876'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:37 user nova-compute[75634]: INFO os_vif [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a')
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] No VIF found with MAC fa:16:3e:9b:0f:7c, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] No waiting events found dispatching network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:39 user nova-compute[75634]: WARNING nova.compute.manager [req-378a7776-36ad-4e8f-b835-4b7a123b48dd req-4662c2f1-f262-48ae-a446-dc2a2d19b76b service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received unexpected event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c for instance with vm_state building and task_state spawning.
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:39:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance spawned successfully.
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] No waiting events found dispatching network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:41 user nova-compute[75634]: WARNING nova.compute.manager [req-7aa09ae7-467e-4eed-8c9c-fb25e834edc2 req-65f91151-a179-48ea-9c43-fc5307804b86 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received unexpected event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c for instance with vm_state building and task_state spawning.
Nov 15 18:39:41 user nova-compute[75634]: INFO nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 15 18:39:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:39:41 user nova-compute[75634]: INFO nova.compute.manager [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Took 6.84 seconds to build instance.
Nov 15 18:39:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-05deca9b-c4b5-4f05-a11d-04760a75025b tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.927s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Waiting for libvirt event about the detach of device tap65176b8f-69 with device alias net1 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 is timed out.
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 18:39:45 user nova-compute[75634]:   <name>instance-00000007</name>
Nov 15 18:39:45 user nova-compute[75634]:   <uuid>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</uuid>
Nov 15 18:39:45 user nova-compute[75634]:   <metadata>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:45 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:38:45</nova:creationTime>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:45 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:45 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:45 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:port uuid="65176b8f-69c0-4f65-86b5-4a895e7ed34f">
Nov 15 18:39:45 user nova-compute[75634]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Nov 15 18:39:45 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:45 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:45 user nova-compute[75634]:   </metadata>
Nov 15 18:39:45 user nova-compute[75634]:   <memory unit='KiB'>524288</memory>
Nov 15 18:39:45 user nova-compute[75634]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 18:39:45 user nova-compute[75634]:   <vcpu placement='static'>1</vcpu>
Nov 15 18:39:45 user nova-compute[75634]:   <resource>
Nov 15 18:39:45 user nova-compute[75634]:     <partition>/machine</partition>
Nov 15 18:39:45 user nova-compute[75634]:   </resource>
Nov 15 18:39:45 user nova-compute[75634]:   <sysinfo type='smbios'>
Nov 15 18:39:45 user nova-compute[75634]:     <system>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='version'>0.0.0</entry>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='serial'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='uuid'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:45 user nova-compute[75634]:       <entry name='family'>Virtual Machine</entry>
Nov 15 18:39:45 user nova-compute[75634]:     </system>
Nov 15 18:39:45 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:45 user nova-compute[75634]:   <os>
Nov 15 18:39:45 user nova-compute[75634]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 18:39:45 user nova-compute[75634]:     <boot dev='hd'/>
Nov 15 18:39:45 user nova-compute[75634]:     <smbios mode='sysinfo'/>
Nov 15 18:39:45 user nova-compute[75634]:   </os>
Nov 15 18:39:45 user nova-compute[75634]:   <features>
Nov 15 18:39:45 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:45 user nova-compute[75634]:     <apic/>
Nov 15 18:39:45 user nova-compute[75634]:     <vmcoreinfo state='on'/>
Nov 15 18:39:45 user nova-compute[75634]:   </features>
Nov 15 18:39:45 user nova-compute[75634]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 18:39:45 user nova-compute[75634]:     <model fallback='forbid'>Nehalem</model>
Nov 15 18:39:45 user nova-compute[75634]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 18:39:45 user nova-compute[75634]:     <feature policy='require' name='vme'/>
Nov 15 18:39:45 user nova-compute[75634]:     <feature policy='require' name='x2apic'/>
Nov 15 18:39:45 user nova-compute[75634]:     <feature policy='require' name='hypervisor'/>
Nov 15 18:39:45 user nova-compute[75634]:   </cpu>
Nov 15 18:39:45 user nova-compute[75634]:   <clock offset='utc'>
Nov 15 18:39:45 user nova-compute[75634]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 18:39:45 user nova-compute[75634]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 18:39:45 user nova-compute[75634]:     <timer name='hpet' present='no'/>
Nov 15 18:39:45 user nova-compute[75634]:   </clock>
Nov 15 18:39:45 user nova-compute[75634]:   <on_poweroff>destroy</on_poweroff>
Nov 15 18:39:45 user nova-compute[75634]:   <on_reboot>restart</on_reboot>
Nov 15 18:39:45 user nova-compute[75634]:   <on_crash>destroy</on_crash>
Nov 15 18:39:45 user nova-compute[75634]:   <devices>
Nov 15 18:39:45 user nova-compute[75634]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 18:39:45 user nova-compute[75634]:     <disk type='file' device='disk'>
Nov 15 18:39:45 user nova-compute[75634]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 18:39:45 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk' index='2'/>
Nov 15 18:39:45 user nova-compute[75634]:       <backingStore type='file' index='3'>
Nov 15 18:39:45 user nova-compute[75634]:         <format type='raw'/>
Nov 15 18:39:45 user nova-compute[75634]:         <source file='/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9'/>
Nov 15 18:39:45 user nova-compute[75634]:         <backingStore/>
Nov 15 18:39:45 user nova-compute[75634]:       </backingStore>
Nov 15 18:39:45 user nova-compute[75634]:       <target dev='vda' bus='virtio'/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='virtio-disk0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </disk>
Nov 15 18:39:45 user nova-compute[75634]:     <disk type='file' device='cdrom'>
Nov 15 18:39:45 user nova-compute[75634]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 18:39:45 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config' index='1'/>
Nov 15 18:39:45 user nova-compute[75634]:       <backingStore/>
Nov 15 18:39:45 user nova-compute[75634]:       <target dev='hda' bus='ide'/>
Nov 15 18:39:45 user nova-compute[75634]:       <readonly/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='ide0-0-0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </disk>
Nov 15 18:39:45 user nova-compute[75634]:     <controller type='usb' index='0' model='none'>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='usb'/>
Nov 15 18:39:45 user nova-compute[75634]:     </controller>
Nov 15 18:39:45 user nova-compute[75634]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='pci.0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </controller>
Nov 15 18:39:45 user nova-compute[75634]:     <controller type='ide' index='0'>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='ide'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 18:39:45 user nova-compute[75634]:     </controller>
Nov 15 18:39:45 user nova-compute[75634]:     <interface type='ethernet'>
Nov 15 18:39:45 user nova-compute[75634]:       <mac address='fa:16:3e:28:4f:cf'/>
Nov 15 18:39:45 user nova-compute[75634]:       <target dev='tap1d52672f-2f'/>
Nov 15 18:39:45 user nova-compute[75634]:       <model type='virtio'/>
Nov 15 18:39:45 user nova-compute[75634]:       <mtu size='1442'/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='net0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </interface>
Nov 15 18:39:45 user nova-compute[75634]:     <serial type='pty'>
Nov 15 18:39:45 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:45 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:45 user nova-compute[75634]:       <target type='isa-serial' port='0'>
Nov 15 18:39:45 user nova-compute[75634]:         <model name='isa-serial'/>
Nov 15 18:39:45 user nova-compute[75634]:       </target>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </serial>
Nov 15 18:39:45 user nova-compute[75634]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 18:39:45 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:45 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:45 user nova-compute[75634]:       <target type='serial' port='0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </console>
Nov 15 18:39:45 user nova-compute[75634]:     <input type='mouse' bus='ps2'>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='input0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </input>
Nov 15 18:39:45 user nova-compute[75634]:     <input type='keyboard' bus='ps2'>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='input1'/>
Nov 15 18:39:45 user nova-compute[75634]:     </input>
Nov 15 18:39:45 user nova-compute[75634]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 18:39:45 user nova-compute[75634]:       <listen type='address' address='0.0.0.0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </graphics>
Nov 15 18:39:45 user nova-compute[75634]:     <audio id='1' type='none'/>
Nov 15 18:39:45 user nova-compute[75634]:     <video>
Nov 15 18:39:45 user nova-compute[75634]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='video0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </video>
Nov 15 18:39:45 user nova-compute[75634]:     <memballoon model='virtio'>
Nov 15 18:39:45 user nova-compute[75634]:       <stats period='10'/>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='balloon0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:45 user nova-compute[75634]:     <rng model='virtio'>
Nov 15 18:39:45 user nova-compute[75634]:       <backend model='random'>/dev/urandom</backend>
Nov 15 18:39:45 user nova-compute[75634]:       <alias name='rng0'/>
Nov 15 18:39:45 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 18:39:45 user nova-compute[75634]:     </rng>
Nov 15 18:39:45 user nova-compute[75634]:   </devices>
Nov 15 18:39:45 user nova-compute[75634]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 18:39:45 user nova-compute[75634]:     <label>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</label>
Nov 15 18:39:45 user nova-compute[75634]:     <imagelabel>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</imagelabel>
Nov 15 18:39:45 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:45 user nova-compute[75634]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 18:39:45 user nova-compute[75634]:     <label>+64055:+108</label>
Nov 15 18:39:45 user nova-compute[75634]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 18:39:45 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:45 user nova-compute[75634]: </domain>
Nov 15 18:39:45 user nova-compute[75634]:  {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 18:39:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully detached device tap65176b8f-69 from instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 from the live domain config.
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG os_vif [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65176b8f-69, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=404a282d-a335-4867-8e20-e8217269c2ba) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:45 user nova-compute[75634]: INFO os_vif [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69')
Nov 15 18:39:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:45 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:39:45</nova:creationTime>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:45 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:45 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:45 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:45 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:45 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:45 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:45 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:45 user nova-compute[75634]:  {{(pid=75634) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-deleted-65176b8f-69c0-4f65-86b5-4a895e7ed34f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:46 user nova-compute[75634]: INFO nova.compute.manager [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Neutron deleted interface 65176b8f-69c0-4f65-86b5-4a895e7ed34f; detaching it from the instance and deleting it from the info cache
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquired lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.objects.instance [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Lazy-loading 'system_metadata' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.objects.instance [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Lazy-loading 'flavor' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.objects.base [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Object Instance<9eb05a7b-5f61-4c36-b751-3ba2f1f857b8> lazy-loaded attributes: system_metadata,flavor {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 18:39:46 user nova-compute[75634]:   <name>instance-00000007</name>
Nov 15 18:39:46 user nova-compute[75634]:   <uuid>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</uuid>
Nov 15 18:39:46 user nova-compute[75634]:   <metadata>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:46 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:39:45</nova:creationTime>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:46 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:46 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:46 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:46 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:46 user nova-compute[75634]:   </metadata>
Nov 15 18:39:46 user nova-compute[75634]:   <memory unit='KiB'>524288</memory>
Nov 15 18:39:46 user nova-compute[75634]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 18:39:46 user nova-compute[75634]:   <vcpu placement='static'>1</vcpu>
Nov 15 18:39:46 user nova-compute[75634]:   <resource>
Nov 15 18:39:46 user nova-compute[75634]:     <partition>/machine</partition>
Nov 15 18:39:46 user nova-compute[75634]:   </resource>
Nov 15 18:39:46 user nova-compute[75634]:   <sysinfo type='smbios'>
Nov 15 18:39:46 user nova-compute[75634]:     <system>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='version'>0.0.0</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='serial'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='uuid'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='family'>Virtual Machine</entry>
Nov 15 18:39:46 user nova-compute[75634]:     </system>
Nov 15 18:39:46 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:46 user nova-compute[75634]:   <os>
Nov 15 18:39:46 user nova-compute[75634]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 18:39:46 user nova-compute[75634]:     <boot dev='hd'/>
Nov 15 18:39:46 user nova-compute[75634]:     <smbios mode='sysinfo'/>
Nov 15 18:39:46 user nova-compute[75634]:   </os>
Nov 15 18:39:46 user nova-compute[75634]:   <features>
Nov 15 18:39:46 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:46 user nova-compute[75634]:     <apic/>
Nov 15 18:39:46 user nova-compute[75634]:     <vmcoreinfo state='on'/>
Nov 15 18:39:46 user nova-compute[75634]:   </features>
Nov 15 18:39:46 user nova-compute[75634]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 18:39:46 user nova-compute[75634]:     <model fallback='forbid'>Nehalem</model>
Nov 15 18:39:46 user nova-compute[75634]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='vme'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='x2apic'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='hypervisor'/>
Nov 15 18:39:46 user nova-compute[75634]:   </cpu>
Nov 15 18:39:46 user nova-compute[75634]:   <clock offset='utc'>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='hpet' present='no'/>
Nov 15 18:39:46 user nova-compute[75634]:   </clock>
Nov 15 18:39:46 user nova-compute[75634]:   <on_poweroff>destroy</on_poweroff>
Nov 15 18:39:46 user nova-compute[75634]:   <on_reboot>restart</on_reboot>
Nov 15 18:39:46 user nova-compute[75634]:   <on_crash>destroy</on_crash>
Nov 15 18:39:46 user nova-compute[75634]:   <devices>
Nov 15 18:39:46 user nova-compute[75634]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 18:39:46 user nova-compute[75634]:     <disk type='file' device='disk'>
Nov 15 18:39:46 user nova-compute[75634]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 18:39:46 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk' index='2'/>
Nov 15 18:39:46 user nova-compute[75634]:       <backingStore type='file' index='3'>
Nov 15 18:39:46 user nova-compute[75634]:         <format type='raw'/>
Nov 15 18:39:46 user nova-compute[75634]:         <source file='/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9'/>
Nov 15 18:39:46 user nova-compute[75634]:         <backingStore/>
Nov 15 18:39:46 user nova-compute[75634]:       </backingStore>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='vda' bus='virtio'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='virtio-disk0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </disk>
Nov 15 18:39:46 user nova-compute[75634]:     <disk type='file' device='cdrom'>
Nov 15 18:39:46 user nova-compute[75634]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 18:39:46 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config' index='1'/>
Nov 15 18:39:46 user nova-compute[75634]:       <backingStore/>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='hda' bus='ide'/>
Nov 15 18:39:46 user nova-compute[75634]:       <readonly/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='ide0-0-0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </disk>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='usb' index='0' model='none'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='usb'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='pci.0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='ide' index='0'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='ide'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <interface type='ethernet'>
Nov 15 18:39:46 user nova-compute[75634]:       <mac address='fa:16:3e:28:4f:cf'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='tap1d52672f-2f'/>
Nov 15 18:39:46 user nova-compute[75634]:       <model type='virtio'/>
Nov 15 18:39:46 user nova-compute[75634]:       <mtu size='1442'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='net0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </interface>
Nov 15 18:39:46 user nova-compute[75634]:     <serial type='pty'>
Nov 15 18:39:46 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:46 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target type='isa-serial' port='0'>
Nov 15 18:39:46 user nova-compute[75634]:         <model name='isa-serial'/>
Nov 15 18:39:46 user nova-compute[75634]:       </target>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </serial>
Nov 15 18:39:46 user nova-compute[75634]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 18:39:46 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:46 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target type='serial' port='0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </console>
Nov 15 18:39:46 user nova-compute[75634]:     <input type='mouse' bus='ps2'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='input0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </input>
Nov 15 18:39:46 user nova-compute[75634]:     <input type='keyboard' bus='ps2'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='input1'/>
Nov 15 18:39:46 user nova-compute[75634]:     </input>
Nov 15 18:39:46 user nova-compute[75634]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 18:39:46 user nova-compute[75634]:       <listen type='address' address='0.0.0.0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </graphics>
Nov 15 18:39:46 user nova-compute[75634]:     <audio id='1' type='none'/>
Nov 15 18:39:46 user nova-compute[75634]:     <video>
Nov 15 18:39:46 user nova-compute[75634]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='video0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </video>
Nov 15 18:39:46 user nova-compute[75634]:     <memballoon model='virtio'>
Nov 15 18:39:46 user nova-compute[75634]:       <stats period='10'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='balloon0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:46 user nova-compute[75634]:     <rng model='virtio'>
Nov 15 18:39:46 user nova-compute[75634]:       <backend model='random'>/dev/urandom</backend>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='rng0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </rng>
Nov 15 18:39:46 user nova-compute[75634]:   </devices>
Nov 15 18:39:46 user nova-compute[75634]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 18:39:46 user nova-compute[75634]:     <label>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</label>
Nov 15 18:39:46 user nova-compute[75634]:     <imagelabel>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</imagelabel>
Nov 15 18:39:46 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:46 user nova-compute[75634]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 18:39:46 user nova-compute[75634]:     <label>+64055:+108</label>
Nov 15 18:39:46 user nova-compute[75634]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 18:39:46 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:46 user nova-compute[75634]: </domain>
Nov 15 18:39:46 user nova-compute[75634]:  {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface> {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:84:ab:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap65176b8f-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 18:39:46 user nova-compute[75634]:   <name>instance-00000007</name>
Nov 15 18:39:46 user nova-compute[75634]:   <uuid>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</uuid>
Nov 15 18:39:46 user nova-compute[75634]:   <metadata>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:46 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:39:45</nova:creationTime>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:46 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:46 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:46 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:46 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:46 user nova-compute[75634]:   </metadata>
Nov 15 18:39:46 user nova-compute[75634]:   <memory unit='KiB'>524288</memory>
Nov 15 18:39:46 user nova-compute[75634]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 18:39:46 user nova-compute[75634]:   <vcpu placement='static'>1</vcpu>
Nov 15 18:39:46 user nova-compute[75634]:   <resource>
Nov 15 18:39:46 user nova-compute[75634]:     <partition>/machine</partition>
Nov 15 18:39:46 user nova-compute[75634]:   </resource>
Nov 15 18:39:46 user nova-compute[75634]:   <sysinfo type='smbios'>
Nov 15 18:39:46 user nova-compute[75634]:     <system>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='version'>0.0.0</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='serial'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='uuid'>9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</entry>
Nov 15 18:39:46 user nova-compute[75634]:       <entry name='family'>Virtual Machine</entry>
Nov 15 18:39:46 user nova-compute[75634]:     </system>
Nov 15 18:39:46 user nova-compute[75634]:   </sysinfo>
Nov 15 18:39:46 user nova-compute[75634]:   <os>
Nov 15 18:39:46 user nova-compute[75634]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 18:39:46 user nova-compute[75634]:     <boot dev='hd'/>
Nov 15 18:39:46 user nova-compute[75634]:     <smbios mode='sysinfo'/>
Nov 15 18:39:46 user nova-compute[75634]:   </os>
Nov 15 18:39:46 user nova-compute[75634]:   <features>
Nov 15 18:39:46 user nova-compute[75634]:     <acpi/>
Nov 15 18:39:46 user nova-compute[75634]:     <apic/>
Nov 15 18:39:46 user nova-compute[75634]:     <vmcoreinfo state='on'/>
Nov 15 18:39:46 user nova-compute[75634]:   </features>
Nov 15 18:39:46 user nova-compute[75634]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 18:39:46 user nova-compute[75634]:     <model fallback='forbid'>Nehalem</model>
Nov 15 18:39:46 user nova-compute[75634]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='vme'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='x2apic'/>
Nov 15 18:39:46 user nova-compute[75634]:     <feature policy='require' name='hypervisor'/>
Nov 15 18:39:46 user nova-compute[75634]:   </cpu>
Nov 15 18:39:46 user nova-compute[75634]:   <clock offset='utc'>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 18:39:46 user nova-compute[75634]:     <timer name='hpet' present='no'/>
Nov 15 18:39:46 user nova-compute[75634]:   </clock>
Nov 15 18:39:46 user nova-compute[75634]:   <on_poweroff>destroy</on_poweroff>
Nov 15 18:39:46 user nova-compute[75634]:   <on_reboot>restart</on_reboot>
Nov 15 18:39:46 user nova-compute[75634]:   <on_crash>destroy</on_crash>
Nov 15 18:39:46 user nova-compute[75634]:   <devices>
Nov 15 18:39:46 user nova-compute[75634]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 18:39:46 user nova-compute[75634]:     <disk type='file' device='disk'>
Nov 15 18:39:46 user nova-compute[75634]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 18:39:46 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk' index='2'/>
Nov 15 18:39:46 user nova-compute[75634]:       <backingStore type='file' index='3'>
Nov 15 18:39:46 user nova-compute[75634]:         <format type='raw'/>
Nov 15 18:39:46 user nova-compute[75634]:         <source file='/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9'/>
Nov 15 18:39:46 user nova-compute[75634]:         <backingStore/>
Nov 15 18:39:46 user nova-compute[75634]:       </backingStore>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='vda' bus='virtio'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='virtio-disk0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </disk>
Nov 15 18:39:46 user nova-compute[75634]:     <disk type='file' device='cdrom'>
Nov 15 18:39:46 user nova-compute[75634]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 18:39:46 user nova-compute[75634]:       <source file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/disk.config' index='1'/>
Nov 15 18:39:46 user nova-compute[75634]:       <backingStore/>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='hda' bus='ide'/>
Nov 15 18:39:46 user nova-compute[75634]:       <readonly/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='ide0-0-0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </disk>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='usb' index='0' model='none'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='usb'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='pci.0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <controller type='ide' index='0'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='ide'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 18:39:46 user nova-compute[75634]:     </controller>
Nov 15 18:39:46 user nova-compute[75634]:     <interface type='ethernet'>
Nov 15 18:39:46 user nova-compute[75634]:       <mac address='fa:16:3e:28:4f:cf'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target dev='tap1d52672f-2f'/>
Nov 15 18:39:46 user nova-compute[75634]:       <model type='virtio'/>
Nov 15 18:39:46 user nova-compute[75634]:       <mtu size='1442'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='net0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </interface>
Nov 15 18:39:46 user nova-compute[75634]:     <serial type='pty'>
Nov 15 18:39:46 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:46 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target type='isa-serial' port='0'>
Nov 15 18:39:46 user nova-compute[75634]:         <model name='isa-serial'/>
Nov 15 18:39:46 user nova-compute[75634]:       </target>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </serial>
Nov 15 18:39:46 user nova-compute[75634]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 18:39:46 user nova-compute[75634]:       <source path='/dev/pts/6'/>
Nov 15 18:39:46 user nova-compute[75634]:       <log file='/opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8/console.log' append='off'/>
Nov 15 18:39:46 user nova-compute[75634]:       <target type='serial' port='0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='serial0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </console>
Nov 15 18:39:46 user nova-compute[75634]:     <input type='mouse' bus='ps2'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='input0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </input>
Nov 15 18:39:46 user nova-compute[75634]:     <input type='keyboard' bus='ps2'>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='input1'/>
Nov 15 18:39:46 user nova-compute[75634]:     </input>
Nov 15 18:39:46 user nova-compute[75634]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 18:39:46 user nova-compute[75634]:       <listen type='address' address='0.0.0.0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </graphics>
Nov 15 18:39:46 user nova-compute[75634]:     <audio id='1' type='none'/>
Nov 15 18:39:46 user nova-compute[75634]:     <video>
Nov 15 18:39:46 user nova-compute[75634]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='video0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </video>
Nov 15 18:39:46 user nova-compute[75634]:     <memballoon model='virtio'>
Nov 15 18:39:46 user nova-compute[75634]:       <stats period='10'/>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='balloon0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </memballoon>
Nov 15 18:39:46 user nova-compute[75634]:     <rng model='virtio'>
Nov 15 18:39:46 user nova-compute[75634]:       <backend model='random'>/dev/urandom</backend>
Nov 15 18:39:46 user nova-compute[75634]:       <alias name='rng0'/>
Nov 15 18:39:46 user nova-compute[75634]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 18:39:46 user nova-compute[75634]:     </rng>
Nov 15 18:39:46 user nova-compute[75634]:   </devices>
Nov 15 18:39:46 user nova-compute[75634]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 18:39:46 user nova-compute[75634]:     <label>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</label>
Nov 15 18:39:46 user nova-compute[75634]:     <imagelabel>libvirt-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8</imagelabel>
Nov 15 18:39:46 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:46 user nova-compute[75634]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 18:39:46 user nova-compute[75634]:     <label>+64055:+108</label>
Nov 15 18:39:46 user nova-compute[75634]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 18:39:46 user nova-compute[75634]:   </seclabel>
Nov 15 18:39:46 user nova-compute[75634]: </domain>
Nov 15 18:39:46 user nova-compute[75634]:  {{(pid=75634) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 18:39:46 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Detaching interface fa:16:3e:84:ab:99 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap65176b8f-69' not found.
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Converting VIF {"id": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "address": "fa:16:3e:84:ab:99", "network": {"id": "4ea6ab9f-7b13-428e-b6c4-0db5b82723c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681226050", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65176b8f-69", "ovs_interfaceid": "65176b8f-69c0-4f65-86b5-4a895e7ed34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG os_vif [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65176b8f-69, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:39:46 user nova-compute[75634]: INFO os_vif [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ab:99,bridge_name='br-int',has_traffic_filtering=True,id=65176b8f-69c0-4f65-86b5-4a895e7ed34f,network=Network(4ea6ab9f-7b13-428e-b6c4-0db5b82723c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65176b8f-69')
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [req-7787c838-52ac-4c38-b90d-e7179ba62ee6 req-60d737f3-d9cc-406d-9876-3957c4787823 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:39:46 user nova-compute[75634]:   <nova:package version="0.0.0"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:name>tempest-device-tagging-server-586493551</nova:name>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:creationTime>2023-11-15 18:39:46</nova:creationTime>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:flavor name="m1.tiny">
Nov 15 18:39:46 user nova-compute[75634]:     <nova:memory>512</nova:memory>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:disk>1</nova:disk>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:swap>0</nova:swap>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:vcpus>1</nova:vcpus>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:flavor>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:user uuid="f47155df59f44ec1aff630140493b530">tempest-TaggedAttachmentsTest-602888094-project-member</nova:user>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:project uuid="676c94de1ba84426900d882f68f2c6e0">tempest-TaggedAttachmentsTest-602888094</nova:project>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:owner>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:39:46 user nova-compute[75634]:   <nova:ports>
Nov 15 18:39:46 user nova-compute[75634]:     <nova:port uuid="1d52672f-2f92-4487-b730-82d4a60db5fc">
Nov 15 18:39:46 user nova-compute[75634]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:39:46 user nova-compute[75634]:     </nova:port>
Nov 15 18:39:46 user nova-compute[75634]:   </nova:ports>
Nov 15 18:39:46 user nova-compute[75634]: </nova:instance>
Nov 15 18:39:46 user nova-compute[75634]:  {{(pid=75634) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [{"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Releasing lock "refresh_cache-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a4e3a73b-9dc0-4aaf-9ddc-a845776e68af tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "interface-9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-65176b8f-69c0-4f65-86b5-4a895e7ed34f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.373s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-changed-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Refreshing instance network info cache due to event network-changed-da47a75e-d09e-4aa7-a704-560afed2588e. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] Acquiring lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] Acquired lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Refreshing network info cache for port da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updated VIF entry in instance network info cache for port da47a75e-d09e-4aa7-a704-560afed2588e. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updating instance_info_cache with network_info: [{"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ba51dab7-e0fe-4ad5-b044-f89bf905e371 req-55a4cb6c-7cfc-49d5-86bf-a280bf795c5b service nova] Releasing lock "refresh_cache-23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lazy-loading 'flavor' on Instance uuid 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:52 user nova-compute[75634]: INFO nova.compute.manager [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Attaching volume bc514f17-41eb-4fa5-aea3-7e31ed35c877 to /dev/vdb
Nov 15 18:39:52 user nova-compute[75634]: DEBUG os_brick.utils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db27e1a-354f-4dc5-abef-afb47c3c6e30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:52 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d9cc6-a911-45b2-8dc6-47ef6d02da06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b2eb23-5f73-4fa4-b9cf-a602da2e634c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[10603191-9685-4ddc-be80-5871db70729c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:39:53 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:39:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a9312e-3b67-4535-aecc-44342325328e]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG os_brick.utils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:53 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updating existing volume attachment record: 58e36f89-9df6-4e0f-9015-050e15cc5025 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:55 user nova-compute[75634]: INFO nova.compute.manager [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Terminating instance
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-unplugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] No waiting events found dispatching network-vif-unplugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-ff631944-b325-49b4-949a-5d988aedd003 req-65e6b38c-70d4-4267-988b-99893a9732f6 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-unplugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Instance destroyed successfully.
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lazy-loading 'resources' on Instance uuid dca2e952-fba6-40b7-8952-5524606cebaf {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1766858696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1766858696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1766858696',id=10,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/1aaZqlYfAeQVVJTYZuoTci4rFKdK6bNjUIrgclgjuDdw3n9bye1M/9RNYzadXUqzKvt1e9sNAZy7zLIuYev7rJTevJiVri5vnsFvUUwQBWoUHHQVf2wR8lyGzfYMi2w==',key_name='tempest-keypair-1912778318',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa3231a5e1864c969836a94a3bead96d',ramdisk_id='',reservation_id='r-q802yzmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1755173631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1755173631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2646dfa956b0401283a0e2585d9152b9',uuid=dca2e952-fba6-40b7-8952-5524606cebaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converting VIF {"id": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "address": "fa:16:3e:15:20:69", "network": {"id": "1bd6c79e-7f01-4338-a280-8db78e1a454d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399133224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3231a5e1864c969836a94a3bead96d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc177e0-f2", "ovs_interfaceid": "dcc177e0-f225-4479-a6d0-0ba2c388b070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG os_vif [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc177e0-f2, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12f285a4-9d4e-4bad-9d57-175f07dbf98e) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:39:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:39:55 user nova-compute[75634]: INFO os_vif [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:20:69,bridge_name='br-int',has_traffic_filtering=True,id=dcc177e0-f225-4479-a6d0-0ba2c388b070,network=Network(1bd6c79e-7f01-4338-a280-8db78e1a454d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc177e0-f2')
Nov 15 18:39:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Deleting instance files /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf_del
Nov 15 18:39:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Deletion of /opt/stack/data/nova/instances/dca2e952-fba6-40b7-8952-5524606cebaf_del complete
Nov 15 18:39:56 user nova-compute[75634]: INFO nova.compute.manager [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 18:39:56 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:39:56 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:39:56 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:39:56 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:39:56 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Took 0.83 seconds to deallocate network for instance.
Nov 15 18:39:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:57 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Deleted allocations for instance dca2e952-fba6-40b7-8952-5524606cebaf
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6cd0cfb2-663d-4790-8648-c228a33754fb tempest-VolumesAssistedSnapshotsTest-1755173631 tempest-VolumesAssistedSnapshotsTest-1755173631-project-member] Lock "dca2e952-fba6-40b7-8952-5524606cebaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] Acquiring lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] Lock "dca2e952-fba6-40b7-8952-5524606cebaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] No waiting events found dispatching network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:39:57 user nova-compute[75634]: WARNING nova.compute.manager [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received unexpected event network-vif-plugged-dcc177e0-f225-4479-a6d0-0ba2c388b070 for instance with vm_state deleted and task_state None.
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-c045a89c-7586-43c2-8db3-a7923a6efefd req-d2ed0dd9-ed15-47c2-ba4c-e40f200466d5 service nova] [instance: dca2e952-fba6-40b7-8952-5524606cebaf] Received event network-vif-deleted-dcc177e0-f225-4479-a6d0-0ba2c388b070 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnXcwEam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:39:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:39:57 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eda378-6357-4414-9534-0dfa455ef666]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:39:57 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b853d-b2ea-4f35-9812-0aad0c657521]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877] added
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b7e17-326a-41f4-906b-9014041f307c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4792218-6cea-4d01-9005-a14478679a03]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnXcwEam {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnXcwEam" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bcd03a-5b54-422b-97a4-8c2f6c54ca47]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZnXcwEam'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53216615-b770-4828-8f14-2ec757f9f049]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc309637-3819-4a54-a646-ce9c5ba73c6c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde6d8d1-924d-4b8b-a0be-9f0f9f02eb41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260]
Nov 15 18:39:58 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260] successful.
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc71629-6df1-474d-a4a4-b7ad78b39709]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b595f2c-8f19-4280-911a-bdb1b186f5f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:39:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8bcf4b-3a2d-4261-b16f-0800af8e4e58]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:39:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnXcwEam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26233653539646438', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233653539646438', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lazy-loading 'flavor' on Instance uuid 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:39:59 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:39:59 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:39:59 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:39:59 user nova-compute[75634]:   <serial>bc514f17-41eb-4fa5-aea3-7e31ed35c877</serial>
Nov 15 18:39:59 user nova-compute[75634]: </disk>
Nov 15 18:39:59 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] No VIF found with MAC fa:16:3e:04:51:1b, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:39:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f2faadf2-4291-4fd3-a996-dd9380baa4bc tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.943s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:01 user nova-compute[75634]: INFO nova.compute.manager [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Detaching volume bc514f17-41eb-4fa5-aea3-7e31ed35c877
Nov 15 18:40:01 user nova-compute[75634]: INFO nova.virt.block_device [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Attempting to driver detach volume bc514f17-41eb-4fa5-aea3-7e31ed35c877 from mountpoint /dev/vdb
Nov 15 18:40:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Attempting to detach device vdb from instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:40:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:40:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:40:01 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:40:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:40:01 user nova-compute[75634]:   <serial>bc514f17-41eb-4fa5-aea3-7e31ed35c877</serial>
Nov 15 18:40:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:40:01 user nova-compute[75634]: </disk>
Nov 15 18:40:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:40:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Successfully detached device vdb from instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 from the persistent domain config.
Nov 15 18:40:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:40:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:40:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:40:01 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:40:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:40:01 user nova-compute[75634]:   <serial>bc514f17-41eb-4fa5-aea3-7e31ed35c877</serial>
Nov 15 18:40:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:40:01 user nova-compute[75634]: </disk>
Nov 15 18:40:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:40:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:03 user nova-compute[75634]: INFO nova.compute.manager [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Terminating instance
Nov 15 18:40:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-unplugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] No waiting events found dispatching network-vif-unplugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-f0591eca-75d8-4095-aa21-b653289394ae req-066736e7-d661-40f7-a8a9-cc283874ea4b service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-unplugged-7f6513a9-437c-48d7-a512-e6cd0c370628 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:40:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Instance destroyed successfully.
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lazy-loading 'resources' on Instance uuid 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1363070356',display_name='tempest-TestVolumeSwap-server-1363070356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1363070356',id=6,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI2egJ/AhiPG2BX9cTTtyPnRBq6HcvMT/tVtGNQru2feCkrhtKoVrZcFKRan3c+EbVaV1KOqHADodTsvN314sQZN1fNtvC1cI1A1NNL8uS5dfHH9522sy/3vBzoIwJs3A==',key_name='tempest-keypair-1648725269',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5f21c0a07dd454dab73c5a21c8c86ee',ramdisk_id='',reservation_id='r-8y7jec4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-93028597',owner_user_name='tempest-TestVolumeSwap-93028597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f6f4b48ddb64bc6b6b8d3236e772686',uuid=7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converting VIF {"id": "7f6513a9-437c-48d7-a512-e6cd0c370628", "address": "fa:16:3e:5f:b1:45", "network": {"id": "28417555-60c8-4e24-87d1-8f8a4a7f9264", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1254934589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5f21c0a07dd454dab73c5a21c8c86ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6513a9-43", "ovs_interfaceid": "7f6513a9-437c-48d7-a512-e6cd0c370628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG os_vif [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f6513a9-43, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a0e1693-1d15-49c6-b030-127286ae850f) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: INFO os_vif [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:b1:45,bridge_name='br-int',has_traffic_filtering=True,id=7f6513a9-437c-48d7-a512-e6cd0c370628,network=Network(28417555-60c8-4e24-87d1-8f8a4a7f9264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6513a9-43')
Nov 15 18:40:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Deleting instance files /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e_del
Nov 15 18:40:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Deletion of /opt/stack/data/nova/instances/7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e_del complete
Nov 15 18:40:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:04 user nova-compute[75634]: INFO nova.compute.manager [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 15 18:40:04 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:40:04 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:05 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Took 1.05 seconds to deallocate network for instance.
Nov 15 18:40:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ca19c9a-b779-4c3b-a07b-4dc8f78f4641 req-18a18b3b-bed3-4db7-afbe-96609771bdb9 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-deleted-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] Acquiring lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] No waiting events found dispatching network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:05 user nova-compute[75634]: WARNING nova.compute.manager [req-b3614837-f70c-411a-b684-1c34baa71f7c req-1c237e55-8b8d-40c5-80e6-b6fbe93463d8 service nova] [instance: 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e] Received unexpected event network-vif-plugged-7f6513a9-437c-48d7-a512-e6cd0c370628 for instance with vm_state deleted and task_state None.
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Deleted allocations for instance 7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.compute.manager [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Terminating instance
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-eb97e034-2ee6-42e3-9a7d-48997e4d4074 tempest-TestVolumeSwap-93028597 tempest-TestVolumeSwap-93028597-project-member] Lock "7ea3f1f0-dbf5-4c6e-8b9e-5e3d0783673e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.574s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Instance destroyed successfully.
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.objects.instance [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lazy-loading 'resources' on Instance uuid 99fe65b6-b8ff-4ee7-9606-5a9b90260b48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736817865',display_name='tempest-ServersNegativeTestJSON-server-736817865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736817865',id=13,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-gyvlrhlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:38:23Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=99fe65b6-b8ff-4ee7-9606-5a9b90260b48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "address": "fa:16:3e:a7:01:75", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a66af1d-34", "ovs_interfaceid": "8a66af1d-34fc-4230-8b38-318d8f9d29b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG os_vif [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a66af1d-34, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df39c95f-9d9b-4863-81ca-aad0a57869f4) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:06 user nova-compute[75634]: INFO os_vif [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:01:75,bridge_name='br-int',has_traffic_filtering=True,id=8a66af1d-34fc-4230-8b38-318d8f9d29b1,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a66af1d-34')
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Deleting instance files /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48_del
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Deletion of /opt/stack/data/nova/instances/99fe65b6-b8ff-4ee7-9606-5a9b90260b48_del complete
Nov 15 18:40:06 user nova-compute[75634]: INFO nova.compute.manager [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 18:40:06 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:40:06 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:07 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Took 0.46 seconds to deallocate network for instance.
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:07 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Deleted allocations for instance 99fe65b6-b8ff-4ee7-9606-5a9b90260b48
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63204328-d5cc-4a65-a56b-d7e559c6706e tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.609s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-vif-unplugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] No waiting events found dispatching network-vif-unplugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:07 user nova-compute[75634]: WARNING nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received unexpected event network-vif-unplugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 for instance with vm_state deleted and task_state None.
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Acquiring lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] Lock "99fe65b6-b8ff-4ee7-9606-5a9b90260b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] No waiting events found dispatching network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:07 user nova-compute[75634]: WARNING nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received unexpected event network-vif-plugged-8a66af1d-34fc-4230-8b38-318d8f9d29b1 for instance with vm_state deleted and task_state None.
Nov 15 18:40:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd14057-9349-4888-9bc6-bb9f7e6a8d79 req-1c7bafac-92b3-4085-ac2c-5ceed9719ac6 service nova] [instance: 99fe65b6-b8ff-4ee7-9606-5a9b90260b48] Received event network-vif-deleted-8a66af1d-34fc-4230-8b38-318d8f9d29b1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'flavor' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: INFO nova.compute.manager [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Attaching volume 599af8bc-18bc-4b32-90ca-ae1a5443109a to /dev/vdb
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.utils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec521c-5096-4431-8c50-91807ae25f6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a14bf5-1fff-41eb-aec3-eb5d213b5859]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9f426-713d-47ba-ba13-d83b23192c35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba85ad6-33df-4be6-8dc2-752daebbd102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:15 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f021810-4a20-49ee-b53f-ba5523461fdf]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG os_brick.utils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating existing volume attachment record: f02a1c8e-c4ed-4ff5-8892-4545a57cf68d {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:15 user nova-compute[75634]: INFO nova.compute.manager [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Terminating instance
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-unplugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-unplugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-450e4422-30cc-403b-81af-e0c1fffd08ec req-cbbe8769-6dd2-4dd3-af97-f25f57fd3849 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-unplugged-1d52672f-2f92-4487-b730-82d4a60db5fc for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:40:15 user nova-compute[75634]: INFO nova.compute.claims [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Claim successful on node user
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Instance destroyed successfully.
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lazy-loading 'resources' on Instance uuid 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-586493551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-586493551',id=7,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj0SfpzOVgKidnDHv7L9kvniuaqAfsKIG8Qc91FrZx8Phvop5s8WmibxwmNIpSbz8Pny/j75UtlmVeaDofqHRNhughK0Ks/0BQBTceajpcGv2seGg7pS8RrCwL8bcfO4Q==',key_name='tempest-keypair-1129730993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676c94de1ba84426900d882f68f2c6e0',ramdisk_id='',reservation_id='r-d1992g0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-602888094',owner_user_name='tempest-TaggedAttachmentsTest-602888094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47155df59f44ec1aff630140493b530',uuid=9eb05a7b-5f61-4c36-b751-3ba2f1f857b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converting VIF {"id": "1d52672f-2f92-4487-b730-82d4a60db5fc", "address": "fa:16:3e:28:4f:cf", "network": {"id": "2b02d7c0-721f-4cd7-a649-94e4c0c9aed1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038128039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "676c94de1ba84426900d882f68f2c6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d52672f-2f", "ovs_interfaceid": "1d52672f-2f92-4487-b730-82d4a60db5fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_vif [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d52672f-2f, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2189527b-ad4f-43b0-a4bf-9eeba3698cb9) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:16 user nova-compute[75634]: INFO os_vif [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:4f:cf,bridge_name='br-int',has_traffic_filtering=True,id=1d52672f-2f92-4487-b730-82d4a60db5fc,network=Network(2b02d7c0-721f-4cd7-a649-94e4c0c9aed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d52672f-2f')
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Deleting instance files /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8_del
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Deletion of /opt/stack/data/nova/instances/9eb05a7b-5f61-4c36-b751-3ba2f1f857b8_del complete
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.compute.manager [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.compute.manager [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Unshelving
Nov 15 18:40:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.block_device [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Booting with volume cd31c717-2bda-4b3c-9060-420540e282ab at /dev/vdc
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.utils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[59551ff9-4685-42d3-91ed-8a7b012d97c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85949ab-2931-4185-8a4a-c777175bb94c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.policy [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ebb5c4075034b1482d50a9ff5dd990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb5adcf609a4fd7a67d3574243cc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[04408c05-1bd4-4b83-8e68-ad05ab108bef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53da64e-0087-46fe-8554-ff14eaf64cd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:16 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0cf401-41bb-43ff-b8be-5881e542a5a1]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG os_brick.utils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating existing volume attachment record: de54617a-9028-4891-8e5a-a80de8e800c6 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:40:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Creating image(s)
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.222s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk 1073741824" returned: 0 in 0.061s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Successfully created port: 0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Cannot resize image /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Ensure instance console log exists: /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] Acquiring lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] No waiting events found dispatching network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:17 user nova-compute[75634]: WARNING nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received unexpected event network-vif-plugged-1d52672f-2f92-4487-b730-82d4a60db5fc for instance with vm_state active and task_state deleting.
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Received event network-vif-deleted-1d52672f-2f92-4487-b730-82d4a60db5fc {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:17 user nova-compute[75634]: INFO nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Neutron deleted interface 1d52672f-2f92-4487-b730-82d4a60db5fc; detaching it from the instance and deleting it from the info cache
Nov 15 18:40:17 user nova-compute[75634]: DEBUG nova.network.neutron [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:17 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Took 1.61 seconds to deallocate network for instance.
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-6fd9accf-1cf1-4519-843d-529ed06acc5c req-49b94d8d-f8d4-46be-8f0f-6b3738342783 service nova] [instance: 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8] Detach interface failed, port_id=1d52672f-2f92-4487-b730-82d4a60db5fc, reason: Instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Successfully updated port: 0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-changed-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Refreshing instance network info cache due to event network-changed-0727a542-fa46-4bf2-8a73-49aa02c2547d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] Acquiring lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:18 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Deleted allocations for instance 9eb05a7b-5f61-4c36-b751-3ba2f1f857b8
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating instance_info_cache with network_info: [{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance network_info: |[{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] Acquired lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Refreshing network info cache for port 0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start _get_guest_xml network_info=[{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fba605b-35e0-4178-b2d6-17e6a1cb3090 tempest-TaggedAttachmentsTest-602888094 tempest-TaggedAttachmentsTest-602888094-project-member] Lock "9eb05a7b-5f61-4c36-b751-3ba2f1f857b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.504s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-tempest.common.compute-instance-2035561163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:18 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'pci_devices' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:40:19 user nova-compute[75634]:   <uuid>e8988672-a7d0-4098-8f85-4fc83584da4d</uuid>
Nov 15 18:40:19 user nova-compute[75634]:   <name>instance-0000000f</name>
Nov 15 18:40:19 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:40:19 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:40:19 user nova-compute[75634]:   <metadata>
Nov 15 18:40:19 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:40:19 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:name>tempest-tempest.common.compute-instance-2035561163</nova:name>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:40:18</nova:creationTime>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:40:19 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:40:19 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:owner>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:user uuid="3ebb5c4075034b1482d50a9ff5dd990b">tempest-ServerActionsTestOtherA-1839012723-project-member</nova:user>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:project uuid="0fb5adcf609a4fd7a67d3574243cc920">tempest-ServerActionsTestOtherA-1839012723</nova:project>
Nov 15 18:40:19 user nova-compute[75634]:       </nova:owner>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:40:19 user nova-compute[75634]:       <nova:ports>
Nov 15 18:40:19 user nova-compute[75634]:         <nova:port uuid="0727a542-fa46-4bf2-8a73-49aa02c2547d">
Nov 15 18:40:19 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:40:19 user nova-compute[75634]:         </nova:port>
Nov 15 18:40:19 user nova-compute[75634]:       </nova:ports>
Nov 15 18:40:19 user nova-compute[75634]:     </nova:instance>
Nov 15 18:40:19 user nova-compute[75634]:   </metadata>
Nov 15 18:40:19 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:40:19 user nova-compute[75634]:     <system>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="serial">e8988672-a7d0-4098-8f85-4fc83584da4d</entry>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="uuid">e8988672-a7d0-4098-8f85-4fc83584da4d</entry>
Nov 15 18:40:19 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:40:19 user nova-compute[75634]:     </system>
Nov 15 18:40:19 user nova-compute[75634]:   </sysinfo>
Nov 15 18:40:19 user nova-compute[75634]:   <os>
Nov 15 18:40:19 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:40:19 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:40:19 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:40:19 user nova-compute[75634]:   </os>
Nov 15 18:40:19 user nova-compute[75634]:   <features>
Nov 15 18:40:19 user nova-compute[75634]:     <acpi/>
Nov 15 18:40:19 user nova-compute[75634]:     <apic/>
Nov 15 18:40:19 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:40:19 user nova-compute[75634]:   </features>
Nov 15 18:40:19 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:40:19 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:40:19 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:40:19 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:40:19 user nova-compute[75634]:   </clock>
Nov 15 18:40:19 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:40:19 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:40:19 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:40:19 user nova-compute[75634]:   </cpu>
Nov 15 18:40:19 user nova-compute[75634]:   <devices>
Nov 15 18:40:19 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:40:19 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:40:19 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk"/>
Nov 15 18:40:19 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:40:19 user nova-compute[75634]:     </disk>
Nov 15 18:40:19 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:40:19 user nova-compute[75634]:       <mac address="fa:16:3e:95:33:70"/>
Nov 15 18:40:19 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:19 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:40:19 user nova-compute[75634]:       <target dev="tap0727a542-fa"/>
Nov 15 18:40:19 user nova-compute[75634]:     </interface>
Nov 15 18:40:19 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:40:19 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/console.log" append="off"/>
Nov 15 18:40:19 user nova-compute[75634]:     </serial>
Nov 15 18:40:19 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:40:19 user nova-compute[75634]:     <video>
Nov 15 18:40:19 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:19 user nova-compute[75634]:     </video>
Nov 15 18:40:19 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:40:19 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:40:19 user nova-compute[75634]:     </rng>
Nov 15 18:40:19 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:40:19 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:40:19 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:40:19 user nova-compute[75634]:     </memballoon>
Nov 15 18:40:19 user nova-compute[75634]:   </devices>
Nov 15 18:40:19 user nova-compute[75634]: </domain>
Nov 15 18:40:19 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-tempest.common.compute-instance-2035561163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG os_vif [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c151304d-0aeb-56d5-8f80-4bba62032f24', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0727a542-fa, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0727a542-fa, col_values=(('qos', UUID('de2dd6ab-a0c9-48ac-982c-1b75b281b56a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0727a542-fa, col_values=(('external_ids', {'iface-id': '0727a542-fa46-4bf2-8a73-49aa02c2547d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:33:70', 'vm-uuid': 'e8988672-a7d0-4098-8f85-4fc83584da4d'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:19 user nova-compute[75634]: INFO os_vif [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa')
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:95:33:70, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.network.neutron [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updated VIF entry in instance network info cache for port 0727a542-fa46-4bf2-8a73-49aa02c2547d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG nova.network.neutron [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating instance_info_cache with network_info: [{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1e17a1b6-d194-4784-85dd-2225d2ae0f4e req-22bc873c-ccd6-4ec4-b3f5-f86a15fea85c service nova] Releasing lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:20 user nova-compute[75634]: WARNING nova.compute.manager [req-d167f429-0b75-4106-bf6a-260e50a11fe4 req-100853c3-7147-4191-8c1f-148edb24924b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state building and task_state spawning.
Nov 15 18:40:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:20 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:20 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:20 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:40:20 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:20 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:20 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.500133514404297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99818c-6fb4-45ab-9e2a-24972a0fe419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:40:20 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed29fbaa-f476-4987-98a4-71b8bc555515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added
Nov 15 18:40:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74f396f-f7af-4acc-b5cd-accbf82c972a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.079s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aded12e-4a79-476f-9a79-99e2cba9dfec]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad3ef7-290b-4922-afd1-a715a15db27f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UevkjIJF'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 65848bf6-8074-4bab-804c-342f3edcc0cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 83ca85a5-8369-4eeb-8a85-e674c6ff3876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0528f178-104d-4d8b-b59a-16ad2696e6dc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1564d-eaca-4d62-a8cd-f069c6173b42]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535daa2-ce3d-4c03-a869-0e0cf1a0cd53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:40:21 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d93d653-3621-4734-93cd-c5526d557d87]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec9717-d22c-43be-bcde-64dab375a79e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:21 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c0d2d8-80bf-450d-bdb0-688cfe0f3f41]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:40:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'flavor' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:40:22 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:40:22 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:40:22 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:40:22 user nova-compute[75634]:   <serial>599af8bc-18bc-4b32-90ca-ae1a5443109a</serial>
Nov 15 18:40:22 user nova-compute[75634]: </disk>
Nov 15 18:40:22 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:40:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 is timed out.
Nov 15 18:40:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Successfully detached device vdb from instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 from the live domain config.
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnXcwEam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:22 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca86a1-f4bc-4bff-8525-e4681a103dfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:40:22 user nova-compute[75634]: No targets found.
Nov 15 18:40:22 user nova-compute[75634]: iSNS:
Nov 15 18:40:22 user nova-compute[75634]: No targets found.
Nov 15 18:40:22 user nova-compute[75634]: STATIC:
Nov 15 18:40:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877
Nov 15 18:40:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:40:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:22 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:40:22 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:22 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:22 user nova-compute[75634]: FIRMWARE:
Nov 15 18:40:22 user nova-compute[75634]: No targets found.
Nov 15 18:40:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:40:22 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:40:22 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b849d11-ae4f-4c47-b1e6-6aaf674415ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_requests' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e94108-467e-4317-bdc8-9455baf331c0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:22 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:22 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:22 user nova-compute[75634]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 (non-flash)
Nov 15 18:40:22 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44476f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'numa_topology' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[463daab3-a020-4bd6-9f1c-5609e5b812e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:40:22 user nova-compute[75634]: INFO nova.compute.claims [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Claim successful on node user
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901c9a5-9cad-4160-85ba-d44ad51933c8]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415bb54-e896-484c-a7ec-e4186afabb3d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6421dd29-0277-4c30-9ab7-55213b4cf9d2]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d039cd-5ac4-4e52-a88a-c5585a8beae7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efab352-7def-4b9a-a2e3-bfb4e61f3a82]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260]
Nov 15 18:40:22 user nova-compute[75634]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No VIF found with MAC fa:16:3e:96:86:92, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc514f17-41eb-4fa5-aea3-7e31ed35c877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d51ed-4789-4ce6-a0c4-1ac2c7a28f6d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] <== disconnect_volume: return (389ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:22 user nova-compute[75634]: WARNING nova.compute.manager [req-b7d7bc7a-d50b-4502-9e88-7514c6b0d413 req-c5d8ad9f-fae5-446e-875a-67850ed48b8b service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state building and task_state spawning.
Nov 15 18:40:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c641e331-3545-4365-b956-2f02d8949c37 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.861s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:40:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance spawned successfully.
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:23 user nova-compute[75634]: INFO nova.network.neutron [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating port 5abcd712-2686-44c8-9798-983e094f7649 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 18:40:23 user nova-compute[75634]: INFO nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:40:23 user nova-compute[75634]: INFO nova.compute.manager [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Took 7.35 seconds to build instance.
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b9698e48-d948-438f-ba8e-2fe030c39ce9 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.466s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lazy-loading 'flavor' on Instance uuid 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3eee9640-51bb-414b-83a6-7860cf4f3b5f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-changed-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing instance network info cache due to event network-changed-5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:40:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] Acquiring lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:40:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Creating image(s)
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'trusted_certs' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] Acquired lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Refreshing network info cache for port 5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG nova.objects.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<d14a0c65-0ba1-4919-80b8-5295e100a7f7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "6abf19a7a2859970169a105436aca88018680aab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "6abf19a7a2859970169a105436aca88018680aab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Stashing vm_state: active {{(pid=75634) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.part --force-share --output=json" returned: 0 in 0.264s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG nova.virt.images [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] 59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.part /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:40:26 user nova-compute[75634]: INFO nova.compute.claims [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Claim successful on node user
Nov 15 18:40:26 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating resource usage from migration 175b171e-3581-4a55-a5ab-9d5a4202f45a
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.part /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.converted" returned: 0 in 0.258s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "6abf19a7a2859970169a105436aca88018680aab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.918s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "6abf19a7a2859970169a105436aca88018680aab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "6abf19a7a2859970169a105436aca88018680aab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.network.neutron [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updated VIF entry in instance network info cache for port 5abcd712-2686-44c8-9798-983e094f7649. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.network.neutron [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-08d9baa1-e8fa-4699-a43c-fc1e76e30428 req-4c8df887-8dbb-4796-b0a2-8708850ae17b service nova] Releasing lock "refresh_cache-d14a0c65-0ba1-4919-80b8-5295e100a7f7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.756s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:27 user nova-compute[75634]: INFO nova.compute.manager [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Migrating
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:27 user nova-compute[75634]: INFO nova.compute.rpcapi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab,backing_fmt=raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab,backing_fmt=raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk 1073741824" returned: 0 in 0.058s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "6abf19a7a2859970169a105436aca88018680aab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab --force-share --output=json" returned: 0 in 0.228s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'migration_context' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<d14a0c65-0ba1-4919-80b8-5295e100a7f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:40:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Rebasing disk image.
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.216s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 -F raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Starting migrate_disk_and_power_off {{(pid=75634) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:28 user nova-compute[75634]: WARNING nova.compute.manager [req-efb5023a-4f30-4026-90bb-f3ce98b50796 req-92f4856c-72ab-4ee7-8b61-3e3e71a23c6a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state resize_migrating.
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance destroyed successfully.
Nov 15 18:40:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3788bac0-17, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d82818a-009e-4e65-b927-9595dd73b33e) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:29 user nova-compute[75634]: INFO os_vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:40:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:29 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a162760-9741-4d9d-afc3-b2fb93a6d970]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:40:29 user nova-compute[75634]: No targets found.
Nov 15 18:40:29 user nova-compute[75634]: iSNS:
Nov 15 18:40:29 user nova-compute[75634]: No targets found.
Nov 15 18:40:29 user nova-compute[75634]: STATIC:
Nov 15 18:40:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:40:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:40:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:29 user nova-compute[75634]: FIRMWARE:
Nov 15 18:40:29 user nova-compute[75634]: No targets found.
Nov 15 18:40:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:40:29 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:40:29 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24c621-e536-4a18-8285-08f1d9d251f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e82844-8619-4659-8e4c-706629f19f96]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:29 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:29 user nova-compute[75634]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b445888b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b225de-d8e6-46e5-9d37-4c6fef4f391e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[df742b7f-38a5-4ae9-bfbe-62783d2d4314]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07fcd7-33e8-4346-b8d8-66c3759a2d23]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47d3c5-1a44-4344-8717-d7ac18b18fb4]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2464ff13-692e-4837-80f9-41fa1e106c4c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1941d-3734-41a0-acd4-c385dc599045]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:40:29 user nova-compute[75634]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5ec35a-199e-45aa-8abd-240bb301678f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== disconnect_volume: return (354ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:40:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_resize/disk /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "cp -r /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_resize/disk /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk" returned: 0 in 0.385s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_resize/disk.info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk.info {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "cp -r /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_resize/disk.info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk.info" returned: 0 in 0.048s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 -F raw /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk" returned: 0 in 3.044s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start _get_guest_xml network_info=[{"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='636cf9a5e619ddf0fbc74d9c55c4f27c',container_format='bare',created_at=2023-11-15T18:38:24Z,direct_url=<?>,disk_format='qcow2',id=59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-12552747-shelved',owner='38d2c43038b241429feffe23bbbf4f1d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T18:38:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZmTYVHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd14a0c65-0ba1-4919-80b8-5295e100a7f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd31c717-2bda-4b3c-9060-420540e282ab', 'serial': 'cd31c717-2bda-4b3c-9060-420540e282ab'}, 'guest_format': None, 'boot_index': None, 'attachment_id': 'de54617a-9028-4891-8e5a-a80de8e800c6', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:40:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='636cf9a5e619ddf0fbc74d9c55c4f27c',container_format='bare',created_at=2023-11-15T18:38:24Z,direct_url=<?>,disk_format='qcow2',id=59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-12552747-shelved',owner='38d2c43038b241429feffe23bbbf4f1d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T18:38:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'vcpu_model' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.objects.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<d14a0c65-0ba1-4919-80b8-5295e100a7f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZmTYVHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:31 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:31 user nova-compute[75634]: WARNING nova.compute.manager [req-754f0384-e1e1-4d4f-b8ad-9fc05a864bd3 req-361a04fc-05b5-425a-bedc-8852c633b263 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state resize_migrating.
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3c987e-f6a1-4f4f-ab10-fe7ab092bd64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:40:31 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b7ad4-8ee4-4f99-84ec-3117848b6271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab] added
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b9fda-fda1-489e-b8f7-a29cfe9b14b1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[20020f2b-ac5b-4074-a8b3-f37789c39714]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZmTYVHz {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZmTYVHz" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ca4ea-9b5a-41d8-8e18-95f6cff01493]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZmTYVHz'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d3fbaa-a939-48e8-8bbd-8daa34a6dbb8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[74450895-4f21-4bed-8574-9c7755a2ec0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab940cd-c56b-40b3-86d9-b3b3751e446e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260]
Nov 15 18:40:31 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac112e55-6af4-4c3c-8025-65f63e75dac9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b4d07-ac65-45de-9215-d94d6af239bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:31 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:31 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22bab25-ebab-461f-a3e4-c77ea3d7429d]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZmTYVHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:31 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Port 3788bac0-17f5-41ed-889d-2649ea453783 binding to destination host user is already ACTIVE {{(pid=75634) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23936356530323865', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936356530323865', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1072552389',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:38:28.521903',shelved_host='user',shelved_image_id='59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_devices' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.objects.base [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<d14a0c65-0ba1-4919-80b8-5295e100a7f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:40:32 user nova-compute[75634]:   <uuid>d14a0c65-0ba1-4919-80b8-5295e100a7f7</uuid>
Nov 15 18:40:32 user nova-compute[75634]:   <name>instance-00000002</name>
Nov 15 18:40:32 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:40:32 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:40:32 user nova-compute[75634]:   <metadata>
Nov 15 18:40:32 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:40:32 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-12552747</nova:name>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:40:31</nova:creationTime>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:40:32 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:40:32 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:owner>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:user uuid="6642c8d206564bc5b510ce6ead09fc2c">tempest-AttachVolumeShelveTestJSON-1234122392-project-member</nova:user>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:project uuid="38d2c43038b241429feffe23bbbf4f1d">tempest-AttachVolumeShelveTestJSON-1234122392</nova:project>
Nov 15 18:40:32 user nova-compute[75634]:       </nova:owner>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:root type="image" uuid="59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e"/>
Nov 15 18:40:32 user nova-compute[75634]:       <nova:ports>
Nov 15 18:40:32 user nova-compute[75634]:         <nova:port uuid="5abcd712-2686-44c8-9798-983e094f7649">
Nov 15 18:40:32 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:40:32 user nova-compute[75634]:         </nova:port>
Nov 15 18:40:32 user nova-compute[75634]:       </nova:ports>
Nov 15 18:40:32 user nova-compute[75634]:     </nova:instance>
Nov 15 18:40:32 user nova-compute[75634]:   </metadata>
Nov 15 18:40:32 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:40:32 user nova-compute[75634]:     <system>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="serial">d14a0c65-0ba1-4919-80b8-5295e100a7f7</entry>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="uuid">d14a0c65-0ba1-4919-80b8-5295e100a7f7</entry>
Nov 15 18:40:32 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:40:32 user nova-compute[75634]:     </system>
Nov 15 18:40:32 user nova-compute[75634]:   </sysinfo>
Nov 15 18:40:32 user nova-compute[75634]:   <os>
Nov 15 18:40:32 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:40:32 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:40:32 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:40:32 user nova-compute[75634]:   </os>
Nov 15 18:40:32 user nova-compute[75634]:   <features>
Nov 15 18:40:32 user nova-compute[75634]:     <acpi/>
Nov 15 18:40:32 user nova-compute[75634]:     <apic/>
Nov 15 18:40:32 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:40:32 user nova-compute[75634]:   </features>
Nov 15 18:40:32 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:40:32 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:40:32 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:40:32 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:40:32 user nova-compute[75634]:   </clock>
Nov 15 18:40:32 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:40:32 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:40:32 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:40:32 user nova-compute[75634]:   </cpu>
Nov 15 18:40:32 user nova-compute[75634]:   <devices>
Nov 15 18:40:32 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:40:32 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:40:32 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk"/>
Nov 15 18:40:32 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:40:32 user nova-compute[75634]:     </disk>
Nov 15 18:40:32 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:40:32 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:40:32 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:40:32 user nova-compute[75634]:       <target dev="vdc" bus="virtio"/>
Nov 15 18:40:32 user nova-compute[75634]:       <serial>cd31c717-2bda-4b3c-9060-420540e282ab</serial>
Nov 15 18:40:32 user nova-compute[75634]:     </disk>
Nov 15 18:40:32 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:40:32 user nova-compute[75634]:       <mac address="fa:16:3e:fa:c4:06"/>
Nov 15 18:40:32 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:32 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:40:32 user nova-compute[75634]:       <target dev="tap5abcd712-26"/>
Nov 15 18:40:32 user nova-compute[75634]:     </interface>
Nov 15 18:40:32 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:40:32 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/console.log" append="off"/>
Nov 15 18:40:32 user nova-compute[75634]:     </serial>
Nov 15 18:40:32 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:40:32 user nova-compute[75634]:     <video>
Nov 15 18:40:32 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:32 user nova-compute[75634]:     </video>
Nov 15 18:40:32 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:40:32 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:40:32 user nova-compute[75634]:     </rng>
Nov 15 18:40:32 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:40:32 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:40:32 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:40:32 user nova-compute[75634]:     </memballoon>
Nov 15 18:40:32 user nova-compute[75634]:   </devices>
Nov 15 18:40:32 user nova-compute[75634]: </domain>
Nov 15 18:40:32 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1072552389',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:38:28.521903',shelved_host='user',shelved_image_id='59dbcfd0-9b1e-4c89-ad55-7bf5b901b50e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG os_vif [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2eadac7-6633-5b3d-8e8b-eb363fb9060f', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5abcd712-26, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5abcd712-26, col_values=(('qos', UUID('0e711955-c125-4a59-b4eb-8b6bc50903d2')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5abcd712-26, col_values=(('external_ids', {'iface-id': '5abcd712-2686-44c8-9798-983e094f7649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:c4:06', 'vm-uuid': 'd14a0c65-0ba1-4919-80b8-5295e100a7f7'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:32 user nova-compute[75634]: INFO os_vif [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26')
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No VIF found with MAC fa:16:3e:fa:c4:06, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG os_brick.utils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f0d1f0-f322-4403-95e7-7fa1c1bbc6c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[474af3db-9907-48a4-824b-bce7e6c782ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aba266-0c47-4a9a-9f89-078178dbe1a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa18e7fb-9b40-408e-b293-cb4241afa8c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:40:33 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:40:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c50988-709d-4db2-ad06-6ef9d21259e2]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG os_brick.utils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:34 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:40:34 user nova-compute[75634]: INFO nova.compute.claims [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Claim successful on node user
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.199s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:40:35 user nova-compute[75634]: INFO nova.compute.claims [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Claim successful on node user
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.policy [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fa393dacc464e1da2ce989f0a3c7d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245b9088595044cbb12b368de21b7cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:40:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Creating image(s)
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "/opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "/opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:35 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.221s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Successfully created port: 193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:40:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk 1073741824" returned: 0 in 0.082s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.policy [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a54ff6670dd74beea8b818f8cbd2e93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b1bd5fcf764dbda726e347edd1e63a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.276s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:40:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance spawned successfully.
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:40:37 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Creating image(s)
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json" returned: 0 in 0.560s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Cannot resize image /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Ensure instance console log exists: /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7f145ab2-05a8-43e8-b453-ec4a8d04d481 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.779s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Successfully created port: 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Successfully updated port: 193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk 1073741824" returned: 0 in 0.064s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquired lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-changed-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Refreshing instance network info cache due to event network-changed-193c6ddf-0d51-4779-8ca2-561420f99759. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] Acquiring lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:40:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Cannot resize image /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Ensure instance console log exists: /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Updating instance_info_cache with network_info: [{"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Releasing lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Instance network_info: |[{"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] Acquired lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Refreshing network info cache for port 193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Start _get_guest_xml network_info=[{"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:40:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1357615068',display_name='tempest-DeleteServersTestJSON-server-1357615068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1357615068',id=16,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='245b9088595044cbb12b368de21b7cb0',ramdisk_id='',reservation_id='r-ns0icx0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-22479761',owner_user_name='tempest-DeleteServersTestJSON-22479761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:36Z,user_data=None,user_id='1fa393dacc464e1da2ce989f0a3c7d29',uuid=f1e387c8-c2b7-4b3f-bef5-67a629090c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converting VIF {"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lazy-loading 'pci_devices' on Instance uuid f1e387c8-c2b7-4b3f-bef5-67a629090c72 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:40:38 user nova-compute[75634]:   <uuid>f1e387c8-c2b7-4b3f-bef5-67a629090c72</uuid>
Nov 15 18:40:38 user nova-compute[75634]:   <name>instance-00000010</name>
Nov 15 18:40:38 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:40:38 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:40:38 user nova-compute[75634]:   <metadata>
Nov 15 18:40:38 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:40:38 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:name>tempest-DeleteServersTestJSON-server-1357615068</nova:name>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:40:38</nova:creationTime>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:40:38 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:40:38 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:owner>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:user uuid="1fa393dacc464e1da2ce989f0a3c7d29">tempest-DeleteServersTestJSON-22479761-project-member</nova:user>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:project uuid="245b9088595044cbb12b368de21b7cb0">tempest-DeleteServersTestJSON-22479761</nova:project>
Nov 15 18:40:38 user nova-compute[75634]:       </nova:owner>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:40:38 user nova-compute[75634]:       <nova:ports>
Nov 15 18:40:38 user nova-compute[75634]:         <nova:port uuid="193c6ddf-0d51-4779-8ca2-561420f99759">
Nov 15 18:40:38 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 18:40:38 user nova-compute[75634]:         </nova:port>
Nov 15 18:40:38 user nova-compute[75634]:       </nova:ports>
Nov 15 18:40:38 user nova-compute[75634]:     </nova:instance>
Nov 15 18:40:38 user nova-compute[75634]:   </metadata>
Nov 15 18:40:38 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:40:38 user nova-compute[75634]:     <system>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="serial">f1e387c8-c2b7-4b3f-bef5-67a629090c72</entry>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="uuid">f1e387c8-c2b7-4b3f-bef5-67a629090c72</entry>
Nov 15 18:40:38 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:40:38 user nova-compute[75634]:     </system>
Nov 15 18:40:38 user nova-compute[75634]:   </sysinfo>
Nov 15 18:40:38 user nova-compute[75634]:   <os>
Nov 15 18:40:38 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:40:38 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:40:38 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:40:38 user nova-compute[75634]:   </os>
Nov 15 18:40:38 user nova-compute[75634]:   <features>
Nov 15 18:40:38 user nova-compute[75634]:     <acpi/>
Nov 15 18:40:38 user nova-compute[75634]:     <apic/>
Nov 15 18:40:38 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:40:38 user nova-compute[75634]:   </features>
Nov 15 18:40:38 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:40:38 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:40:38 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:40:38 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:40:38 user nova-compute[75634]:   </clock>
Nov 15 18:40:38 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:40:38 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:40:38 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:40:38 user nova-compute[75634]:   </cpu>
Nov 15 18:40:38 user nova-compute[75634]:   <devices>
Nov 15 18:40:38 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:40:38 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:40:38 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk"/>
Nov 15 18:40:38 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:40:38 user nova-compute[75634]:     </disk>
Nov 15 18:40:38 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:40:38 user nova-compute[75634]:       <mac address="fa:16:3e:21:2b:b3"/>
Nov 15 18:40:38 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:38 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:40:38 user nova-compute[75634]:       <target dev="tap193c6ddf-0d"/>
Nov 15 18:40:38 user nova-compute[75634]:     </interface>
Nov 15 18:40:38 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:40:38 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/console.log" append="off"/>
Nov 15 18:40:38 user nova-compute[75634]:     </serial>
Nov 15 18:40:38 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:40:38 user nova-compute[75634]:     <video>
Nov 15 18:40:38 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:38 user nova-compute[75634]:     </video>
Nov 15 18:40:38 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:40:38 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:40:38 user nova-compute[75634]:     </rng>
Nov 15 18:40:38 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:40:38 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:40:38 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:40:38 user nova-compute[75634]:     </memballoon>
Nov 15 18:40:38 user nova-compute[75634]:   </devices>
Nov 15 18:40:38 user nova-compute[75634]: </domain>
Nov 15 18:40:38 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1357615068',display_name='tempest-DeleteServersTestJSON-server-1357615068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1357615068',id=16,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='245b9088595044cbb12b368de21b7cb0',ramdisk_id='',reservation_id='r-ns0icx0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-22479761',owner_user_name='tempest-DeleteServersTestJSON-22479761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:36Z,user_data=None,user_id='1fa393dacc464e1da2ce989f0a3c7d29',uuid=f1e387c8-c2b7-4b3f-bef5-67a629090c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converting VIF {"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG os_vif [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de1e1fce-1724-5f1b-bacb-a2be1e1247ce', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap193c6ddf-0d, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap193c6ddf-0d, col_values=(('qos', UUID('c6218a04-27de-497d-b0d6-8d55fcfb58e1')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap193c6ddf-0d, col_values=(('external_ids', {'iface-id': '193c6ddf-0d51-4779-8ca2-561420f99759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:2b:b3', 'vm-uuid': 'f1e387c8-c2b7-4b3f-bef5-67a629090c72'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:38 user nova-compute[75634]: INFO os_vif [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d')
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Successfully updated port: 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquired lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] No VIF found with MAC fa:16:3e:21:2b:b3, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-changed-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Refreshing instance network info cache due to event network-changed-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] Acquiring lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Updated VIF entry in instance network info cache for port 193c6ddf-0d51-4779-8ca2-561420f99759. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Updating instance_info_cache with network_info: [{"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7eea023-5773-4979-89c3-2c0c37b46d7a req-40883a33-a010-41bf-91f1-99d6f7b01425 service nova] Releasing lock "refresh_cache-f1e387c8-c2b7-4b3f-bef5-67a629090c72" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Starting finish_migration {{(pid=75634) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:40:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Creating image(s)
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updating instance_info_cache with network_info: [{"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Releasing lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Instance network_info: |[{"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] Acquired lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Refreshing network info cache for port 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Start _get_guest_xml network_info=[{"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:40:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-169176126',display_name='tempest-AttachVolumeNegativeTest-server-169176126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-169176126',id=17,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMl1F1yspa1UYMxHa9lLNdrJcbrHV+0U2acjaTiKKobscfXbr+cQ2hrO/wNQJMTUwNjrgHDb6t/CqpiqYNo3iorDa9u06psfKa9WRgF7UGow460BtPWtKCfIKYPodNqPA==',key_name='tempest-keypair-1946616824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-3t40jsv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=aa6bb849-3c0b-4ee5-9851-853c7cad944d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'pci_devices' on Instance uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.236s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk. size=21474836480 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:40:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:40:39 user nova-compute[75634]:   <uuid>aa6bb849-3c0b-4ee5-9851-853c7cad944d</uuid>
Nov 15 18:40:39 user nova-compute[75634]:   <name>instance-00000011</name>
Nov 15 18:40:39 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:40:39 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:40:39 user nova-compute[75634]:   <metadata>
Nov 15 18:40:39 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:40:39 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeNegativeTest-server-169176126</nova:name>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:40:38</nova:creationTime>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:40:39 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:40:39 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:owner>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:user uuid="a54ff6670dd74beea8b818f8cbd2e93c">tempest-AttachVolumeNegativeTest-1838989545-project-member</nova:user>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:project uuid="a8b1bd5fcf764dbda726e347edd1e63a">tempest-AttachVolumeNegativeTest-1838989545</nova:project>
Nov 15 18:40:39 user nova-compute[75634]:       </nova:owner>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:40:39 user nova-compute[75634]:       <nova:ports>
Nov 15 18:40:39 user nova-compute[75634]:         <nova:port uuid="8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0">
Nov 15 18:40:39 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 18:40:39 user nova-compute[75634]:         </nova:port>
Nov 15 18:40:39 user nova-compute[75634]:       </nova:ports>
Nov 15 18:40:39 user nova-compute[75634]:     </nova:instance>
Nov 15 18:40:39 user nova-compute[75634]:   </metadata>
Nov 15 18:40:39 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:40:39 user nova-compute[75634]:     <system>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="serial">aa6bb849-3c0b-4ee5-9851-853c7cad944d</entry>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="uuid">aa6bb849-3c0b-4ee5-9851-853c7cad944d</entry>
Nov 15 18:40:39 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:40:39 user nova-compute[75634]:     </system>
Nov 15 18:40:39 user nova-compute[75634]:   </sysinfo>
Nov 15 18:40:39 user nova-compute[75634]:   <os>
Nov 15 18:40:39 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:40:39 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:40:39 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:40:39 user nova-compute[75634]:   </os>
Nov 15 18:40:39 user nova-compute[75634]:   <features>
Nov 15 18:40:39 user nova-compute[75634]:     <acpi/>
Nov 15 18:40:39 user nova-compute[75634]:     <apic/>
Nov 15 18:40:39 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:40:39 user nova-compute[75634]:   </features>
Nov 15 18:40:39 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:40:39 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:40:39 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:40:39 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:40:39 user nova-compute[75634]:   </clock>
Nov 15 18:40:39 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:40:39 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:40:39 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:40:39 user nova-compute[75634]:   </cpu>
Nov 15 18:40:39 user nova-compute[75634]:   <devices>
Nov 15 18:40:39 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:40:39 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:40:39 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk"/>
Nov 15 18:40:39 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:40:39 user nova-compute[75634]:     </disk>
Nov 15 18:40:39 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:40:39 user nova-compute[75634]:       <mac address="fa:16:3e:4a:7b:21"/>
Nov 15 18:40:39 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:39 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:40:39 user nova-compute[75634]:       <target dev="tap8a67beff-cb"/>
Nov 15 18:40:39 user nova-compute[75634]:     </interface>
Nov 15 18:40:39 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:40:39 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/console.log" append="off"/>
Nov 15 18:40:39 user nova-compute[75634]:     </serial>
Nov 15 18:40:39 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:40:39 user nova-compute[75634]:     <video>
Nov 15 18:40:39 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:39 user nova-compute[75634]:     </video>
Nov 15 18:40:39 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:40:39 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:40:39 user nova-compute[75634]:     </rng>
Nov 15 18:40:39 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:40:39 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:40:39 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:40:39 user nova-compute[75634]:     </memballoon>
Nov 15 18:40:39 user nova-compute[75634]:   </devices>
Nov 15 18:40:39 user nova-compute[75634]: </domain>
Nov 15 18:40:39 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-169176126',display_name='tempest-AttachVolumeNegativeTest-server-169176126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-169176126',id=17,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMl1F1yspa1UYMxHa9lLNdrJcbrHV+0U2acjaTiKKobscfXbr+cQ2hrO/wNQJMTUwNjrgHDb6t/CqpiqYNo3iorDa9u06psfKa9WRgF7UGow460BtPWtKCfIKYPodNqPA==',key_name='tempest-keypair-1946616824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-3t40jsv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=aa6bb849-3c0b-4ee5-9851-853c7cad944d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_vif [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a6fee28-298d-5bb2-92b2-bd7fdec1c1f0', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a67beff-cb, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a67beff-cb, col_values=(('qos', UUID('f50b0627-959d-4599-a08a-f98e6baa7328')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a67beff-cb, col_values=(('external_ids', {'iface-id': '8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:7b:21', 'vm-uuid': 'aa6bb849-3c0b-4ee5-9851-853c7cad944d'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:39 user nova-compute[75634]: INFO os_vif [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb')
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk 21474836480 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:39 user nova-compute[75634]: WARNING nova.compute.manager [req-e0c6b177-7380-4bbf-bb74-e55df58f30a6 req-cd080c02-b085-4e1e-a1f5-433b4ade2f10 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state None.
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:4a:7b:21, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk 21474836480" returned: 0 in 0.163s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Ensure instance console log exists: /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start _get_guest_xml network_info=[{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '46998ac1-8bf2-4277-a9cd-f8ecf53c5576', 'attached_at': '2023-11-15T18:40:39.000000', 'detached_at': '', 'volume_id': '599af8bc-18bc-4b32-90ca-ae1a5443109a', 'serial': '599af8bc-18bc-4b32-90ca-ae1a5443109a'}, 'guest_format': None, 'boot_index': None, 'attachment_id': '53d4cc49-f8e0-4ad1-bd7a-d7bf17b2305e', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:40:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:39 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a25926-5701-47f9-adf6-721b03f6b569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:40:39 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff935106-7a28-429c-ae8d-95051567100a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updated VIF entry in instance network info cache for port 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updating instance_info_cache with network_info: [{"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea661c97-8964-402a-8a5d-9fc327240bcb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ece4e44-af80-49e1-8d0e-a5c6d23f1c87 req-11291133-6b29-47b2-9d3b-2ed748758129 service nova] Releasing lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af0cb32-4673-4f63-9d37-9a1a88fb0946]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436e4d7-5113-4b0d-893e-06acb39317a9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UevkjIJF'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cdd226-f09d-47f9-a181-dc7b25a5175a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a288f-8e96-4d3e-968f-b07b272629d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a8c0b-018b-46de-bdba-6698633e9c5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:40:39 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac472c20-3d1d-489d-9896-627a108b1552]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e425d62-4be0-4fc5-beb4-221573d745a5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:39 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca65f49-ae21-46b8-b48c-1d619011b3d4]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:40:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] No waiting events found dispatching network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:40 user nova-compute[75634]: WARNING nova.compute.manager [req-3610d4cc-e9eb-47d5-95d5-0d78cb727331 req-bf49696e-4441-4263-8c3d-8523d45498bd service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received unexpected event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 for instance with vm_state building and task_state spawning.
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:40:40 user nova-compute[75634]:   <uuid>46998ac1-8bf2-4277-a9cd-f8ecf53c5576</uuid>
Nov 15 18:40:40 user nova-compute[75634]:   <name>instance-00000003</name>
Nov 15 18:40:40 user nova-compute[75634]:   <memory>2097152</memory>
Nov 15 18:40:40 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:40:40 user nova-compute[75634]:   <metadata>
Nov 15 18:40:40 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:40:40 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherB-server-2001600215</nova:name>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:40:39</nova:creationTime>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:flavor name="m1.small">
Nov 15 18:40:40 user nova-compute[75634]:         <nova:memory>2048</nova:memory>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:disk>20</nova:disk>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:40:40 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:owner>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:user uuid="32a76663d88d4a4ea090919a67c801a8">tempest-ServerActionsTestOtherB-1858282954-project-member</nova:user>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:project uuid="7bed672b3528475bb3bbe7f4eecfd7c5">tempest-ServerActionsTestOtherB-1858282954</nova:project>
Nov 15 18:40:40 user nova-compute[75634]:       </nova:owner>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:40:40 user nova-compute[75634]:       <nova:ports>
Nov 15 18:40:40 user nova-compute[75634]:         <nova:port uuid="3788bac0-17f5-41ed-889d-2649ea453783">
Nov 15 18:40:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:40:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:40:40 user nova-compute[75634]:       </nova:ports>
Nov 15 18:40:40 user nova-compute[75634]:     </nova:instance>
Nov 15 18:40:40 user nova-compute[75634]:   </metadata>
Nov 15 18:40:40 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:40:40 user nova-compute[75634]:     <system>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="serial">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="uuid">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:40:40 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:40:40 user nova-compute[75634]:     </system>
Nov 15 18:40:40 user nova-compute[75634]:   </sysinfo>
Nov 15 18:40:40 user nova-compute[75634]:   <os>
Nov 15 18:40:40 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:40:40 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:40:40 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:40:40 user nova-compute[75634]:   </os>
Nov 15 18:40:40 user nova-compute[75634]:   <features>
Nov 15 18:40:40 user nova-compute[75634]:     <acpi/>
Nov 15 18:40:40 user nova-compute[75634]:     <apic/>
Nov 15 18:40:40 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:40:40 user nova-compute[75634]:   </features>
Nov 15 18:40:40 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:40:40 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:40:40 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:40:40 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:40:40 user nova-compute[75634]:   </clock>
Nov 15 18:40:40 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:40:40 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:40:40 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:40:40 user nova-compute[75634]:   </cpu>
Nov 15 18:40:40 user nova-compute[75634]:   <devices>
Nov 15 18:40:40 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:40:40 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:40:40 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk"/>
Nov 15 18:40:40 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:40:40 user nova-compute[75634]:     </disk>
Nov 15 18:40:40 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:40:40 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:40:40 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:40:40 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:40:40 user nova-compute[75634]:       <serial>599af8bc-18bc-4b32-90ca-ae1a5443109a</serial>
Nov 15 18:40:40 user nova-compute[75634]:     </disk>
Nov 15 18:40:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:40:40 user nova-compute[75634]:       <mac address="fa:16:3e:96:86:92"/>
Nov 15 18:40:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:40:40 user nova-compute[75634]:       <target dev="tap3788bac0-17"/>
Nov 15 18:40:40 user nova-compute[75634]:     </interface>
Nov 15 18:40:40 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:40:40 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/console.log" append="off"/>
Nov 15 18:40:40 user nova-compute[75634]:     </serial>
Nov 15 18:40:40 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:40:40 user nova-compute[75634]:     <video>
Nov 15 18:40:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:40:40 user nova-compute[75634]:     </video>
Nov 15 18:40:40 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:40:40 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:40:40 user nova-compute[75634]:     </rng>
Nov 15 18:40:40 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:40:40 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:40:40 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:40:40 user nova-compute[75634]:     </memballoon>
Nov 15 18:40:40 user nova-compute[75634]:   </devices>
Nov 15 18:40:40 user nova-compute[75634]: </domain>
Nov 15 18:40:40 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1889895319-network", "vif_mac": "fa:16:3e:96:86:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG os_vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50831446-03e2-5796-952a-8afb1664d053', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3788bac0-17, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3788bac0-17, col_values=(('qos', UUID('6933efe4-5835-4ff9-8975-2704b188616a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3788bac0-17, col_values=(('external_ids', {'iface-id': '3788bac0-17f5-41ed-889d-2649ea453783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:86:92', 'vm-uuid': '46998ac1-8bf2-4277-a9cd-f8ecf53c5576'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:40 user nova-compute[75634]: INFO os_vif [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:40:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] No VIF found with MAC fa:16:3e:96:86:92, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:41 user nova-compute[75634]: WARNING nova.compute.manager [req-1ee8db96-c015-4995-9a45-ff3766fc748e req-bb70fb93-9107-438c-8c4d-fcb5f7c88590 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state active and task_state None.
Nov 15 18:40:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] No waiting events found dispatching network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:41 user nova-compute[75634]: WARNING nova.compute.manager [req-52048326-930c-4ac7-bc9b-4403fd4c1c75 req-6f78784b-a230-4aa5-b06b-f34e160966a7 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received unexpected event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 for instance with vm_state building and task_state spawning.
Nov 15 18:40:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] No waiting events found dispatching network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:42 user nova-compute[75634]: WARNING nova.compute.manager [req-b4ea244e-3d99-43a0-b7aa-cd8c890ce5f6 req-e60b132e-3f34-4b65-ade1-b6a977403e0f service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received unexpected event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 for instance with vm_state building and task_state spawning.
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:42 user nova-compute[75634]: INFO nova.compute.manager [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Terminating instance
Nov 15 18:40:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:43 user nova-compute[75634]: WARNING nova.compute.manager [req-e603bfcc-ea10-440f-abf5-a762bf11f387 req-4ed83158-60fa-45c3-a208-956b2e5f1dd3 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state deleting.
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Instance destroyed successfully.
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lazy-loading 'resources' on Instance uuid 65848bf6-8074-4bab-804c-342f3edcc0cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-915106744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071587773',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAH/nNEVSkmcpZze2fm6VEVoeClEfzCCkDhOJaYWJMLr89MpwVYPrUloafXiJf/yvxF3HWC/tjMxyBy0amkbwlZim7jyC6SlLt2aSvf1lxw2cuGRRPCB7iZ1PRGfzzSAg==',key_name='tempest-keypair-1636739753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70b00f11d8394be995ee987ac4f9fbaf',ramdisk_id='',reservation_id='r-eza8xpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1306189062',owner_user_name='tempest-ServerActionsV293TestJSON-1306189062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ddac01d950041a99517eed7b12d02bb',uuid=65848bf6-8074-4bab-804c-342f3edcc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converting VIF {"id": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "address": "fa:16:3e:f5:32:32", "network": {"id": "7f825895-40b2-4c50-a8fc-9ed1bbe68bca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-438247454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b00f11d8394be995ee987ac4f9fbaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3caf5f-9f", "ovs_interfaceid": "5d3caf5f-9f37-4a79-abe5-c26c67dc074c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_vif [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d3caf5f-9f, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=196100c5-d56b-4bf0-aed4-358cc53c6c77) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:43 user nova-compute[75634]: INFO os_vif [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:32:32,bridge_name='br-int',has_traffic_filtering=True,id=5d3caf5f-9f37-4a79-abe5-c26c67dc074c,network=Network(7f825895-40b2-4c50-a8fc-9ed1bbe68bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3caf5f-9f')
Nov 15 18:40:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwUvDiFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:40:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f5f1d-1c1a-4fc7-a47c-89f76596f4d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:40:43 user nova-compute[75634]: No targets found.
Nov 15 18:40:43 user nova-compute[75634]: iSNS:
Nov 15 18:40:43 user nova-compute[75634]: No targets found.
Nov 15 18:40:43 user nova-compute[75634]: STATIC:
Nov 15 18:40:43 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:40:43 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:43 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:43 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0
Nov 15 18:40:43 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:43 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:43 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:40:43 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:40:43 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:40:43 user nova-compute[75634]: FIRMWARE:
Nov 15 18:40:43 user nova-compute[75634]: No targets found.
Nov 15 18:40:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:40:43 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:40:43 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:40:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b72e0-4966-4a6d-bbf5-6c887653ee1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[077bec3d-951a-411c-b9ef-ac02911533b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:44 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:44 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 (non-flash)
Nov 15 18:40:44 user nova-compute[75634]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:40:44 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:40:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b447b4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] No waiting events found dispatching network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:44 user nova-compute[75634]: WARNING nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received unexpected event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 for instance with vm_state building and task_state spawning.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:44 user nova-compute[75634]: WARNING nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state resize_finish.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:44 user nova-compute[75634]: WARNING nova.compute.manager [req-77e7f6cf-0f95-4ee7-b339-0618352fe770 req-d985204e-2537-4af8-9d06-cb9bdee87727 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state resize_finish.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c982c-738d-410d-8157-bc34efe34316]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bffeec-4952-4de6-9855-7b9e3075e358]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[973fafb7-68c7-4e4f-9dae-3e4c2b8bd3fd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a585bf1-030e-4dee-ba97-6157214c04a3]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebae96-ee85-4d2c-afe4-ed2da86cf0e2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a343466-4caa-44b8-9501-cdb35b17ffa9]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260]
Nov 15 18:40:44 user nova-compute[75634]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0, portal: 172.16.0.220,3260] successful.
Nov 15 18:40:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1688aff-0b69-4d67-85ac-a78bb49f11a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f87eb-c16d-419b-8d3e-4055ad3d37a0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] <== disconnect_volume: return (356ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deleting instance files /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc_del
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deletion of /opt/stack/data/nova/instances/65848bf6-8074-4bab-804c-342f3edcc0cc_del complete
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.compute.manager [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Took 1.83 seconds to destroy the instance on the hypervisor.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Instance spawned successfully.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Took 9.08 seconds to spawn the instance on the hypervisor.
Nov 15 18:40:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:40:44 user nova-compute[75634]: INFO nova.compute.manager [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Took 10.05 seconds to build instance.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa7692a8-f494-47ad-82b7-5970a9a00257 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.204s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:45 user nova-compute[75634]: WARNING nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state deleting.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:45 user nova-compute[75634]: WARNING nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state deleting.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-unplugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Acquiring lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] No waiting events found dispatching network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:45 user nova-compute[75634]: WARNING nova.compute.manager [req-a9682949-c018-4fe6-9367-9d39f052a559 req-5539e750-8799-4d94-82d7-68083f7b3348 service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received unexpected event network-vif-plugged-5d3caf5f-9f37-4a79-abe5-c26c67dc074c for instance with vm_state active and task_state deleting.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:45 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Took 1.23 seconds to deallocate network for instance.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:40:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance running successfully.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Failed to set time: agent not configured {{(pid=75634) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bd27e11a-1a4c-4202-9f0f-49d9bbf9aa32 tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] finish_migration finished successfully. {{(pid=75634) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:40:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Instance spawned successfully.
Nov 15 18:40:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3727231-979d-4367-bf02-8cb9e9945518 req-0d1f6466-ad59-4520-a703-732ec1c7685a service nova] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Received event network-vif-deleted-5d3caf5f-9f37-4a79-abe5-c26c67dc074c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:46 user nova-compute[75634]: INFO nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Took 9.06 seconds to spawn the instance on the hypervisor.
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:40:46 user nova-compute[75634]: INFO nova.compute.manager [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Took 11.01 seconds to build instance.
Nov 15 18:40:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b7ade370-466c-4213-b073-cddc6871116a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.149s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:46 user nova-compute[75634]: INFO nova.compute.manager [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Took 0.91 seconds to detach 1 volumes for instance.
Nov 15 18:40:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] [instance: 65848bf6-8074-4bab-804c-342f3edcc0cc] Deleting volume: d1688aff-0b69-4d67-85ac-a78bb49f11a0 {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:47 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:47 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.678s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:47 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Deleted allocations for instance 65848bf6-8074-4bab-804c-342f3edcc0cc
Nov 15 18:40:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-298cd509-61df-4c6f-8b2f-575d7ec09d85 tempest-ServerActionsV293TestJSON-1306189062 tempest-ServerActionsV293TestJSON-1306189062-project-member] Lock "65848bf6-8074-4bab-804c-342f3edcc0cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.010s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:54 user nova-compute[75634]: INFO nova.compute.manager [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Terminating instance
Nov 15 18:40:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-unplugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] No waiting events found dispatching network-vif-unplugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-fba610b5-1638-429d-9c3b-9f341ea66ef8 req-fee69f61-85bc-491c-98e0-ab47d99a86bd service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-unplugged-da47a75e-d09e-4aa7-a704-560afed2588e for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:40:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Instance destroyed successfully.
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lazy-loading 'resources' on Instance uuid 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-634852650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6348526',id=12,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGiW7D4yR/Nsf6vmxJWA0NLHiOTHYlsqUFO6y06TjyoZ3AMne4nxo4HW0Pir5mefu9wTNHcPvbb+r++B44pMJQxj41RydhnAeozPfSXVbOsFZuHVR77jDLwj/mrFMmaaA==',key_name='tempest-keypair-1843885164',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9fff42c46264ff583eedea85f2f1bba',ramdisk_id='',reservation_id='r-kz9k9mas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214f13af13d64a1a83b311fcd6ef77c0',uuid=23714f8f-5f5d-4ec2-907d-c5ed8346d0f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converting VIF {"id": "da47a75e-d09e-4aa7-a704-560afed2588e", "address": "fa:16:3e:04:51:1b", "network": {"id": "ae694f6a-f507-43b7-83ed-93e1c60d3829", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2137108453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9fff42c46264ff583eedea85f2f1bba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda47a75e-d0", "ovs_interfaceid": "da47a75e-d09e-4aa7-a704-560afed2588e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG os_vif [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda47a75e-d0, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6beae07-e092-411b-a005-03a6e99a84a2) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:40:55 user nova-compute[75634]: INFO os_vif [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:51:1b,bridge_name='br-int',has_traffic_filtering=True,id=da47a75e-d09e-4aa7-a704-560afed2588e,network=Network(ae694f6a-f507-43b7-83ed-93e1c60d3829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda47a75e-d0')
Nov 15 18:40:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Deleting instance files /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1_del
Nov 15 18:40:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Deletion of /opt/stack/data/nova/instances/23714f8f-5f5d-4ec2-907d-c5ed8346d0f1_del complete
Nov 15 18:40:55 user nova-compute[75634]: INFO nova.compute.manager [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 18:40:55 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:40:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:40:57 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Took 1.57 seconds to deallocate network for instance.
Nov 15 18:40:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] Acquiring lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] No waiting events found dispatching network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:40:57 user nova-compute[75634]: WARNING nova.compute.manager [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received unexpected event network-vif-plugged-da47a75e-d09e-4aa7-a704-560afed2588e for instance with vm_state deleted and task_state None.
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-e78fcd42-f6a1-4e95-94d1-e12d9ff380b9 req-bf7e0baa-6b4a-409f-b3c1-30aea1114041 service nova] [instance: 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1] Received event network-vif-deleted-da47a75e-d09e-4aa7-a704-560afed2588e {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:40:57 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Deleted allocations for instance 23714f8f-5f5d-4ec2-907d-c5ed8346d0f1
Nov 15 18:40:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6e478622-9277-4a33-8db6-fab0b8195f4f tempest-TestServerVolumeAttachScenarioOldVersion-1734844809 tempest-TestServerVolumeAttachScenarioOldVersion-1734844809-project-member] Lock "23714f8f-5f5d-4ec2-907d-c5ed8346d0f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7314MB free_disk=25.364757537841797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Applying migration context for instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 as it has an incoming, in-progress migration 175b171e-3581-4a55-a5ab-9d5a4202f45a. Migration status is finished {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 18:41:22 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating resource usage from migration 175b171e-3581-4a55-a5ab-9d5a4202f45a
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 83ca85a5-8369-4eeb-8a85-e674c6ff3876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Migration 175b171e-3581-4a55-a5ab-9d5a4202f45a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f1e387c8-c2b7-4b3f-bef5-67a629090c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance aa6bb849-3c0b-4ee5-9851-853c7cad944d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:41:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:41:23 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:41:23 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:41:23 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:41:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:41:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating instance_info_cache with network_info: [{"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-fc102a8d-d379-40c7-9b38-ed423ee1a5c7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:41:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:41:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:28 user nova-compute[75634]: INFO nova.compute.manager [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Terminating instance
Nov 15 18:41:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:41:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-unplugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] No waiting events found dispatching network-vif-unplugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-76644ec6-8088-4a52-898b-0c156c68e352 req-b4d4f960-6574-4283-a265-34d18f246814 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-unplugged-d69446d8-0a84-47bb-a13c-e64b6503153c for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:41:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Instance destroyed successfully.
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'resources' on Instance uuid 83ca85a5-8369-4eeb-8a85-e674c6ff3876 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2074663907',display_name='tempest-VolumesAdminNegativeTest-server-2074663907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2074663907',id=14,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-uqdmi6wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:39:41Z,user_data=None,user_id='3a3dc42740164b32b830f419a10be05e',uuid=83ca85a5-8369-4eeb-8a85-e674c6ff3876,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "d69446d8-0a84-47bb-a13c-e64b6503153c", "address": "fa:16:3e:9b:0f:7c", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69446d8-0a", "ovs_interfaceid": "d69446d8-0a84-47bb-a13c-e64b6503153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG os_vif [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69446d8-0a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc62021b-af00-44f3-bb17-8a0741cb5ee6) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:29 user nova-compute[75634]: INFO os_vif [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d69446d8-0a84-47bb-a13c-e64b6503153c,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69446d8-0a')
Nov 15 18:41:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Deleting instance files /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876_del
Nov 15 18:41:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Deletion of /opt/stack/data/nova/instances/83ca85a5-8369-4eeb-8a85-e674c6ff3876_del complete
Nov 15 18:41:29 user nova-compute[75634]: INFO nova.compute.manager [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 18:41:29 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:41:29 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-d70c55bc-f2ca-4c92-a6a0-0d2ce7518a02 req-8718eece-2248-4df5-a613-21a034485194 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-deleted-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:30 user nova-compute[75634]: INFO nova.compute.manager [req-d70c55bc-f2ca-4c92-a6a0-0d2ce7518a02 req-8718eece-2248-4df5-a613-21a034485194 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Neutron deleted interface d69446d8-0a84-47bb-a13c-e64b6503153c; detaching it from the instance and deleting it from the info cache
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-d70c55bc-f2ca-4c92-a6a0-0d2ce7518a02 req-8718eece-2248-4df5-a613-21a034485194 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:30 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Took 0.57 seconds to deallocate network for instance.
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-d70c55bc-f2ca-4c92-a6a0-0d2ce7518a02 req-8718eece-2248-4df5-a613-21a034485194 service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Detach interface failed, port_id=d69446d8-0a84-47bb-a13c-e64b6503153c, reason: Instance 83ca85a5-8369-4eeb-8a85-e674c6ff3876 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:41:30 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:31 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Deleted allocations for instance 83ca85a5-8369-4eeb-8a85-e674c6ff3876
Nov 15 18:41:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2c77cb8-05ac-470d-af71-4a2ce653c2fc tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] Acquiring lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] Lock "83ca85a5-8369-4eeb-8a85-e674c6ff3876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] No waiting events found dispatching network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:41:31 user nova-compute[75634]: WARNING nova.compute.manager [req-50ed45b8-9d35-4f23-9e6b-acfc2694bfc4 req-b03c5cd0-ea20-417a-a690-2a89c5bec72e service nova] [instance: 83ca85a5-8369-4eeb-8a85-e674c6ff3876] Received unexpected event network-vif-plugged-d69446d8-0a84-47bb-a13c-e64b6503153c for instance with vm_state deleted and task_state None.
Nov 15 18:41:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:41:47 user nova-compute[75634]: INFO nova.compute.claims [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Claim successful on node user
Nov 15 18:41:47 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:41:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.policy [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000d54e8a82d48b58f554ae085a4dab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17eb80780ad4231889417dab82ea2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:41:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Creating image(s)
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.240s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk 1073741824" returned: 0 in 0.053s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Successfully created port: 8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Cannot resize image /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Ensure instance console log exists: /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:49 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:41:49 user nova-compute[75634]: INFO nova.compute.claims [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Claim successful on node user
Nov 15 18:41:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Successfully updated port: 8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-changed-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Refreshing instance network info cache due to event network-changed-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] Acquiring lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:41:50 user nova-compute[75634]: INFO nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Booting with volume 4b748e78-8493-4094-9998-8a01593cba8d at /dev/vda
Nov 15 18:41:50 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66d51a-a986-43c0-944e-0e7dce7eb17f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0481b21-dcd6-4243-a14e-42923aa3e8e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4fe61-cf73-4410-a3a6-8b56830d8036]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc41bc-cfd8-4912-b3d7-0fe0217e7a77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:41:50 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:41:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147c5a5-566d-44ba-8400-1c13352b59d8]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating existing volume attachment record: d79c87d2-e298-40f1-96f7-397157ed1a00 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.policy [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a080c7dadb14ea39593f92fa0f8044a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f4d1fa34694b47bf6c8f216cc6c7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.neutron [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Instance network_info: |[{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] Acquired lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Refreshing network info cache for port 8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Start _get_guest_xml network_info=[{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:41:51 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:51 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-574738749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-574738749',id=18,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-hzvbiw71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:48Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=5f73c5a4-1de9-4239-bcb8-2bb91bf42fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.objects.instance [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:41:51 user nova-compute[75634]:   <uuid>5f73c5a4-1de9-4239-bcb8-2bb91bf42fff</uuid>
Nov 15 18:41:51 user nova-compute[75634]:   <name>instance-00000012</name>
Nov 15 18:41:51 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:41:51 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:41:51 user nova-compute[75634]:   <metadata>
Nov 15 18:41:51 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:41:51 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-574738749</nova:name>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:41:51</nova:creationTime>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:41:51 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:41:51 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:owner>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:41:51 user nova-compute[75634]:       </nova:owner>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:41:51 user nova-compute[75634]:       <nova:ports>
Nov 15 18:41:51 user nova-compute[75634]:         <nova:port uuid="8a6e3c9a-ea2d-49a7-977e-354e6b9817d5">
Nov 15 18:41:51 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:41:51 user nova-compute[75634]:         </nova:port>
Nov 15 18:41:51 user nova-compute[75634]:       </nova:ports>
Nov 15 18:41:51 user nova-compute[75634]:     </nova:instance>
Nov 15 18:41:51 user nova-compute[75634]:   </metadata>
Nov 15 18:41:51 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:41:51 user nova-compute[75634]:     <system>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="serial">5f73c5a4-1de9-4239-bcb8-2bb91bf42fff</entry>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="uuid">5f73c5a4-1de9-4239-bcb8-2bb91bf42fff</entry>
Nov 15 18:41:51 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:41:51 user nova-compute[75634]:     </system>
Nov 15 18:41:51 user nova-compute[75634]:   </sysinfo>
Nov 15 18:41:51 user nova-compute[75634]:   <os>
Nov 15 18:41:51 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:41:51 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:41:51 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:41:51 user nova-compute[75634]:   </os>
Nov 15 18:41:51 user nova-compute[75634]:   <features>
Nov 15 18:41:51 user nova-compute[75634]:     <acpi/>
Nov 15 18:41:51 user nova-compute[75634]:     <apic/>
Nov 15 18:41:51 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:41:51 user nova-compute[75634]:   </features>
Nov 15 18:41:51 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:41:51 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:41:51 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:41:51 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:41:51 user nova-compute[75634]:   </clock>
Nov 15 18:41:51 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:41:51 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:41:51 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:41:51 user nova-compute[75634]:   </cpu>
Nov 15 18:41:51 user nova-compute[75634]:   <devices>
Nov 15 18:41:51 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:41:51 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:41:51 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk"/>
Nov 15 18:41:51 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:41:51 user nova-compute[75634]:     </disk>
Nov 15 18:41:51 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:41:51 user nova-compute[75634]:       <mac address="fa:16:3e:54:a3:75"/>
Nov 15 18:41:51 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:41:51 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:41:51 user nova-compute[75634]:       <target dev="tap8a6e3c9a-ea"/>
Nov 15 18:41:51 user nova-compute[75634]:     </interface>
Nov 15 18:41:51 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:41:51 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/console.log" append="off"/>
Nov 15 18:41:51 user nova-compute[75634]:     </serial>
Nov 15 18:41:51 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:41:51 user nova-compute[75634]:     <video>
Nov 15 18:41:51 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:41:51 user nova-compute[75634]:     </video>
Nov 15 18:41:51 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:41:51 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:41:51 user nova-compute[75634]:     </rng>
Nov 15 18:41:51 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:41:51 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:41:51 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:41:51 user nova-compute[75634]:     </memballoon>
Nov 15 18:41:51 user nova-compute[75634]:   </devices>
Nov 15 18:41:51 user nova-compute[75634]: </domain>
Nov 15 18:41:51 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-574738749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-574738749',id=18,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-hzvbiw71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:48Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=5f73c5a4-1de9-4239-bcb8-2bb91bf42fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG os_vif [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60e81dea-e336-5e4e-b3b4-90ce85380cec', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a6e3c9a-ea, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a6e3c9a-ea, col_values=(('qos', UUID('d3a78a10-e865-4c4d-a78c-78046af57fcf')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a6e3c9a-ea, col_values=(('external_ids', {'iface-id': '8a6e3c9a-ea2d-49a7-977e-354e6b9817d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:a3:75', 'vm-uuid': '5f73c5a4-1de9-4239-bcb8-2bb91bf42fff'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:51 user nova-compute[75634]: INFO os_vif [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea')
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:54:a3:75, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updated VIF entry in instance network info cache for port 8a6e3c9a-ea2d-49a7-977e-354e6b9817d5. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c6e4f73-03c5-4bba-8d2a-d0fb7667aeae req-27230d94-e1ce-4798-958f-60bf974eecbb service nova] Releasing lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:51 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully created port: d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:52 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully created port: 0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:41:53 user nova-compute[75634]: WARNING nova.compute.manager [req-b3d75e7d-3305-4068-8f33-d4b8999e4e40 req-c5a55812-f72b-47ff-9e08-82a8763848f4 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state building and task_state spawning.
Nov 15 18:41:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully created port: 057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:41:54 user nova-compute[75634]: INFO nova.compute.claims [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Claim successful on node user
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:41:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully created port: d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:41:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Creating image(s)
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "/opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "/opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "/opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG nova.policy [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5ccd186caec4537a98be34699d1a1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb145ba27ca5420591deefadf264ff39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:41:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:41:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Instance spawned successfully.
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:41:55 user nova-compute[75634]: WARNING nova.compute.manager [req-0c4084e4-a732-416e-967f-c3db128c482e req-22b8e870-c4f2-46df-8afd-4000914d88d5 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state building and task_state spawning.
Nov 15 18:41:55 user nova-compute[75634]: INFO nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk 1073741824" returned: 0 in 0.066s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:55 user nova-compute[75634]: INFO nova.compute.manager [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Took 7.88 seconds to build instance.
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-77b9fb45-5cdc-4413-8401-e2e680765557 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.984s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Cannot resize image /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Ensure instance console log exists: /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:41:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully created port: a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Successfully created port: 40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:41:56 user nova-compute[75634]: INFO nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Booting with volume 2f7b487c-336e-4afd-a5d5-d07dda4250be at /dev/vdb
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e630fa53-52dc-4378-ad08-6a84a1e5ed97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737028f-a04f-4ca0-b83c-2b24ebe0d1f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af4f96-4ecd-42bb-8dc9-a7a98e604613]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db7cb3-3397-41c1-9af6-817d0830499c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:41:56 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:41:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[df901ef4-aba3-4cbe-abd7-f0ecfc3947cc]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:41:56 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating existing volume attachment record: ed4c12cf-6853-4765-a85b-e6eb1ee63ea0 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-d6c2806f-364a-4af9-a63a-f05271d7bf06. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.network.neutron [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Successfully updated port: 40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-changed-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Refreshing instance network info cache due to event network-changed-40106406-5d49-4704-8ec4-ee3f09af1869. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] Acquiring lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] Acquired lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:57 user nova-compute[75634]: DEBUG nova.network.neutron [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Refreshing network info cache for port 40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dc495b6e-6b1e-4b4e-a93f-a83e9867d1f9 req-33e80213-4ac8-4b6a-9772-b29fa3cd4169 service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: 9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-edc4627a-93fa-43b0-8648-8c1874d6f387 req-96c9285d-95e6-42eb-b06d-14047add72ca service nova] Releasing lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquired lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:41:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating instance_info_cache with network_info: [{"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Releasing lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance network_info: |[{"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Start _get_guest_xml network_info=[{"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:41:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1789050795',display_name='tempest-VolumesSnapshotTestJSON-instance-1789050795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1789050795',id=20,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8GQZQDQ2yUx/FdK6bE+Rt5sXQEpLLOgh5M27pPRhTePxPKISGq6kdzSiKW+WFolTbdZJcxlkIGsl0udcEgyYveVDsAB1IiqG8Z7EJ0WzB7cU8CVGVqbvBYNi7QAedS+Q==',key_name='tempest-keypair-1638587469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-d0m5uwrc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=54932a79-b9a3-4735-a317-a4b2b5a38443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'pci_devices' on Instance uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-9c335e11-f89c-4856-9374-7498e2c1a93d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port 9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:41:59 user nova-compute[75634]:   <uuid>54932a79-b9a3-4735-a317-a4b2b5a38443</uuid>
Nov 15 18:41:59 user nova-compute[75634]:   <name>instance-00000014</name>
Nov 15 18:41:59 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:41:59 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:41:59 user nova-compute[75634]:   <metadata>
Nov 15 18:41:59 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:41:59 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1789050795</nova:name>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:41:59</nova:creationTime>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:41:59 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:41:59 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:owner>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:user uuid="c5ccd186caec4537a98be34699d1a1a1">tempest-VolumesSnapshotTestJSON-2133351772-project-member</nova:user>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:project uuid="fb145ba27ca5420591deefadf264ff39">tempest-VolumesSnapshotTestJSON-2133351772</nova:project>
Nov 15 18:41:59 user nova-compute[75634]:       </nova:owner>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:41:59 user nova-compute[75634]:       <nova:ports>
Nov 15 18:41:59 user nova-compute[75634]:         <nova:port uuid="40106406-5d49-4704-8ec4-ee3f09af1869">
Nov 15 18:41:59 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:41:59 user nova-compute[75634]:         </nova:port>
Nov 15 18:41:59 user nova-compute[75634]:       </nova:ports>
Nov 15 18:41:59 user nova-compute[75634]:     </nova:instance>
Nov 15 18:41:59 user nova-compute[75634]:   </metadata>
Nov 15 18:41:59 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:41:59 user nova-compute[75634]:     <system>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="serial">54932a79-b9a3-4735-a317-a4b2b5a38443</entry>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="uuid">54932a79-b9a3-4735-a317-a4b2b5a38443</entry>
Nov 15 18:41:59 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:41:59 user nova-compute[75634]:     </system>
Nov 15 18:41:59 user nova-compute[75634]:   </sysinfo>
Nov 15 18:41:59 user nova-compute[75634]:   <os>
Nov 15 18:41:59 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:41:59 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:41:59 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:41:59 user nova-compute[75634]:   </os>
Nov 15 18:41:59 user nova-compute[75634]:   <features>
Nov 15 18:41:59 user nova-compute[75634]:     <acpi/>
Nov 15 18:41:59 user nova-compute[75634]:     <apic/>
Nov 15 18:41:59 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:41:59 user nova-compute[75634]:   </features>
Nov 15 18:41:59 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:41:59 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:41:59 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:41:59 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:41:59 user nova-compute[75634]:   </clock>
Nov 15 18:41:59 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:41:59 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:41:59 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:41:59 user nova-compute[75634]:   </cpu>
Nov 15 18:41:59 user nova-compute[75634]:   <devices>
Nov 15 18:41:59 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:41:59 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:41:59 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk"/>
Nov 15 18:41:59 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:41:59 user nova-compute[75634]:     </disk>
Nov 15 18:41:59 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:41:59 user nova-compute[75634]:       <mac address="fa:16:3e:11:7d:7a"/>
Nov 15 18:41:59 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:41:59 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:41:59 user nova-compute[75634]:       <target dev="tap40106406-5d"/>
Nov 15 18:41:59 user nova-compute[75634]:     </interface>
Nov 15 18:41:59 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:41:59 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/console.log" append="off"/>
Nov 15 18:41:59 user nova-compute[75634]:     </serial>
Nov 15 18:41:59 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:41:59 user nova-compute[75634]:     <video>
Nov 15 18:41:59 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:41:59 user nova-compute[75634]:     </video>
Nov 15 18:41:59 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:41:59 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:41:59 user nova-compute[75634]:     </rng>
Nov 15 18:41:59 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:41:59 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:41:59 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:41:59 user nova-compute[75634]:     </memballoon>
Nov 15 18:41:59 user nova-compute[75634]:   </devices>
Nov 15 18:41:59 user nova-compute[75634]: </domain>
Nov 15 18:41:59 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1789050795',display_name='tempest-VolumesSnapshotTestJSON-instance-1789050795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1789050795',id=20,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8GQZQDQ2yUx/FdK6bE+Rt5sXQEpLLOgh5M27pPRhTePxPKISGq6kdzSiKW+WFolTbdZJcxlkIGsl0udcEgyYveVDsAB1IiqG8Z7EJ0WzB7cU8CVGVqbvBYNi7QAedS+Q==',key_name='tempest-keypair-1638587469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-d0m5uwrc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=54932a79-b9a3-4735-a317-a4b2b5a38443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG os_vif [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59dabf55-581d-5859-8346-2c7a9899e0b2', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40106406-5d, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40106406-5d, col_values=(('qos', UUID('2aa0ec83-00a4-4640-8af0-1ef9262bb299')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40106406-5d, col_values=(('external_ids', {'iface-id': '40106406-5d49-4704-8ec4-ee3f09af1869', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:7d:7a', 'vm-uuid': '54932a79-b9a3-4735-a317-a4b2b5a38443'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:41:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:41:59 user nova-compute[75634]: INFO os_vif [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d')
Nov 15 18:41:59 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No VIF found with MAC fa:16:3e:11:7d:7a, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a38a713-33c1-428a-b9cc-e7071ec64d39 req-e0ec853b-42bf-444d-8f0c-0ad3042810da service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: 0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: 057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-c259b69f-6a94-4872-a9e7-ddd5a7934263. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:01 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-0b292661-4105-4170-8c61-337f9138a0b6. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port 0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:02 user nova-compute[75634]: INFO nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Booting with volume 3bd95688-205a-4af6-83a2-9ec8ac5db977 at /dev/vdc
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d9f77b-da4d-493a-984a-95ae1849a01d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[39423464-f114-4417-80f3-3ea822a71203]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ffe0c-a7bc-4eda-9b0f-113147ac5b68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c800252-383d-4fcd-a938-2a30b195d7f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-057a5bf9-46aa-4a7f-9b62-dd416a745484. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port 057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:02 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1246d65-1ea9-4628-8d28-231c7a118c1a]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG os_brick.utils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:02 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating existing volume attachment record: 58bfaee1-5c88-433e-9571-c12c982fc235 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Successfully updated port: a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c7e28b1-e4d9-4461-bd3b-afb7419d9c10 req-efad1ca1-429d-4648-8039-00466bce25f1 service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:03 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance spawned successfully.
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-d72f5027-30d7-44f7-8d0e-36ceeb9526d3. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:04 user nova-compute[75634]: INFO nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 15 18:42:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:04 user nova-compute[75634]: INFO nova.compute.manager [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Took 10.25 seconds to build instance.
Nov 15 18:42:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-432dc9eb-cce9-4d85-912c-ecc1974575a3 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.362s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG nova.network.neutron [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance network_info: |[{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] No waiting events found dispatching network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:06 user nova-compute[75634]: WARNING nova.compute.manager [req-b8197fcc-e5cc-412c-89de-f46bad7492ca req-696a87f4-8fe9-4fe8-b3c3-d25ff9b6d05e service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received unexpected event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 for instance with vm_state active and task_state None.
Nov 15 18:42:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:07 user nova-compute[75634]: INFO nova.compute.manager [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Detaching volume cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:42:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:07 user nova-compute[75634]: INFO nova.virt.block_device [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Attempting to driver detach volume cd31c717-2bda-4b3c-9060-420540e282ab from mountpoint /dev/vdc
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Attempting to detach device vdc from instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:42:07 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:07 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:42:07 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 18:42:07 user nova-compute[75634]:   <serial>cd31c717-2bda-4b3c-9060-420540e282ab</serial>
Nov 15 18:42:07 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:42:07 user nova-compute[75634]: </disk>
Nov 15 18:42:07 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:42:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully detached device vdc from instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 from the persistent domain config.
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:42:07 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:07 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:42:07 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 18:42:07 user nova-compute[75634]:   <serial>cd31c717-2bda-4b3c-9060-420540e282ab</serial>
Nov 15 18:42:07 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:42:07 user nova-compute[75634]: </disk>
Nov 15 18:42:07 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updated VIF entry in instance network info cache for port d72f5027-30d7-44f7-8d0e-36ceeb9526d3. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-a218593a-e2e1-4c5f-abef-f5a59ea29f8a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updated VIF entry in instance network info cache for port a218593a-e2e1-4c5f-abef-f5a59ea29f8a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.network.neutron [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2b0878a-1e69-4cfc-8d84-d9a2a9ec8cc1 req-4d064951-2bde-41cf-89ed-547db73adece service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] No waiting events found dispatching network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:08 user nova-compute[75634]: WARNING nova.compute.manager [req-ee004a00-e017-4876-9bf8-bc432c89bfaa req-9a4406ad-0e1d-45b1-807f-f07ecfab027f service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received unexpected event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 for instance with vm_state active and task_state None.
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-changed-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Refreshing instance network info cache due to event network-changed-0727a542-fa46-4bf2-8a73-49aa02c2547d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] Acquiring lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] Acquired lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.network.neutron [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Refreshing network info cache for port 0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:42:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Creating image(s)
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Ensure instance console log exists: /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Start _get_guest_xml network_info=[{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWIhOGtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765', 'attached_at': '', 'detached_at': '', 'volume_id': '4b748e78-8493-4094-9998-8a01593cba8d', 'serial': '4b748e78-8493-4094-9998-8a01593cba8d'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': 'd79c87d2-e298-40f1-96f7-397157ed1a00', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAnBPxug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765', 'attached_at': '', 'detached_at': '', 'volume_id': '2f7b487c-336e-4afd-a5d5-d07dda4250be', 'serial': '2f7b487c-336e-4afd-a5d5-d07dda4250be'}, 'guest_format': None, 'boot_index': 1, 'attachment_id': 'ed4c12cf-6853-4765-a85b-e6eb1ee63ea0', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQGcCnov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765', 'attached_at': '', 'detached_at': '', 'volume_id': '3bd95688-205a-4af6-83a2-9ec8ac5db977', 'serial': '3bd95688-205a-4af6-83a2-9ec8ac5db977'}, 'guest_format': None, 'boot_index': 2, 'attachment_id': '58bfaee1-5c88-433e-9571-c12c982fc235', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWIhOGtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:08 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:08 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:08 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d7653-933f-4cff-aff4-c4eb7bcf7937]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:08 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'flavor' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f80f88-02cb-409b-bda5-4db026a2b6f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d] added
Nov 15 18:42:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbba399e-ab31-41af-93aa-1fc1517db530]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebf006-f3c0-4885-aaf5-e0cf28a902bc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWIhOGtD {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWIhOGtD" returned: 0 in 0.042s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e308ae-4006-428b-8c83-2f448f1d964f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWIhOGtD'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e1749-f4ab-41aa-8169-f7b4d61c56e4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92583b46-4cf7-4ea2-ac92-7b4fa358f6c0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2831fd-a94d-4df8-93e4-7331d608328e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260]
Nov 15 18:42:09 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:09 user nova-compute[75634]: INFO nova.compute.manager [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attaching volume adc5a166-a8c2-4e98-aae8-2a643ca432a2 to /dev/vdb
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c8f9c7-2d95-46be-802b-ae46e573877b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc6c6d3-0a77-4e54-8381-6101bf8cd23a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:09 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:09 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.utils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf6a3c-43d6-4282-a5b3-6cdbf0fcd7d0]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWIhOGtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d34dc-0665-4679-97d8-5672b67768f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9737ad-9137-4bd0-a995-267d40784da3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG nova.network.neutron [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updated VIF entry in instance network info cache for port 0727a542-fa46-4bf2-8a73-49aa02c2547d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG nova.network.neutron [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating instance_info_cache with network_info: [{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b6fcc-1b35-491d-a55f-0eea43998692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab3404-d7f9-4843-9416-5884df96c550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5bc29cf-6d27-4446-a048-657ef95653ef req-c9ba3fbe-b9a7-40ab-b6f9-415fe3ab11b4 service nova] Releasing lock "refresh_cache-e8988672-a7d0-4098-8f85-4fc83584da4d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:09 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06712da-4cd3-4fd2-b434-cf2623c85852]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG os_brick.utils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating existing volume attachment record: 4063cd6e-1ba9-4ee6-bd9b-503f06faff47 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:42:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23465633837323863', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465633837323863', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAnBPxug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:10 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:10 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:10 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3d27b-4fac-4dbf-a172-719bdacd1f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:10 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db5ea6d-1ffc-45bf-a1bd-65c4e60d757b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be] added
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2fb86-6784-4b18-b300-a52564382b6f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab5357-0b58-449c-a5c1-30e43c4c97ea]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAnBPxug {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAnBPxug" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a36003-691e-4876-9530-3d1a18a33d38]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAnBPxug'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5ea4ca-45b2-430d-b8e2-c1d7ecba7855]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed65b90b-6147-4e24-b778-f76ee64ffb5c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5040bae-58bc-4558-8562-83d3bd762caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260]
Nov 15 18:42:10 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b988f31-6ab1-4656-a814-93657f5f4424]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e1a9c-21fe-4216-b332-1ce61dbacb97]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:10 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:10 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6960b83-3520-445c-8555-f501c5da4e6d]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:10 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAnBPxug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23734316561366637', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734316561366637', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQGcCnov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:11 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:11 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:11 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb23c70-04dd-4a3f-8b45-1f9e6b8c70df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:11 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c12d1-d29f-46f7-aa0a-e1c86fee36fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977] added
Nov 15 18:42:11 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:11 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bded68ad-faa9-4150-9592-dfbfcee2e98a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c1be8f-f90d-4fe1-bccb-f325e3778ad8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQGcCnov {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQGcCnov" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad15e4a-174e-4d9d-b6da-a7b13174e627]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQGcCnov'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2e36d-96a8-4bbf-bd58-354ba907f775]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970fd0d-4168-4078-b17c-44108d360772]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0abe7-d204-4ba7-97ed-70adba3be369]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260]
Nov 15 18:42:12 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ef3a9-7e9b-4e6c-b50b-d86ec2577e37]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1c5aa-4096-415c-9a10-0ca6a31aa8e7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:12 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:42:12 user nova-compute[75634]: INFO nova.compute.claims [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Claim successful on node user
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b17d2c5-3778-4127-8898-538dfd4b4709]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQGcCnov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:42:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:42:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.policy [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd17a4320e9264810ba96eba3fcd707cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eff43206fc5450ebe346f72798856f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:42:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Creating image(s)
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "/opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "/opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "/opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '26434343337663339', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434343337663339', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.objects.instance [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lazy-loading 'pci_devices' on Instance uuid 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:13 user nova-compute[75634]:   <uuid>4548ea11-be1d-4c8c-b3a3-31b5ad0c6765</uuid>
Nov 15 18:42:13 user nova-compute[75634]:   <name>instance-00000013</name>
Nov 15 18:42:13 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:13 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:13 user nova-compute[75634]:   <metadata>
Nov 15 18:42:13 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:13 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:name>tempest-device-tagging-server-1751197559</nova:name>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:08</nova:creationTime>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:13 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:13 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:user uuid="1a080c7dadb14ea39593f92fa0f8044a">tempest-TaggedBootDevicesTest-1080184460-project-member</nova:user>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:project uuid="50f4d1fa34694b47bf6c8f216cc6c7fc">tempest-TaggedBootDevicesTest-1080184460</nova:project>
Nov 15 18:42:13 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:13 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="d6c2806f-364a-4af9-a63a-f05271d7bf06">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="9c335e11-f89c-4856-9374-7498e2c1a93d">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="c259b69f-6a94-4872-a9e7-ddd5a7934263">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="0b292661-4105-4170-8c61-337f9138a0b6">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="057a5bf9-46aa-4a7f-9b62-dd416a745484">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="d72f5027-30d7-44f7-8d0e-36ceeb9526d3">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:         <nova:port uuid="a218593a-e2e1-4c5f-abef-f5a59ea29f8a">
Nov 15 18:42:13 user nova-compute[75634]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 18:42:13 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:13 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:13 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:13 user nova-compute[75634]:   </metadata>
Nov 15 18:42:13 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:13 user nova-compute[75634]:     <system>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="serial">4548ea11-be1d-4c8c-b3a3-31b5ad0c6765</entry>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="uuid">4548ea11-be1d-4c8c-b3a3-31b5ad0c6765</entry>
Nov 15 18:42:13 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:13 user nova-compute[75634]:     </system>
Nov 15 18:42:13 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:13 user nova-compute[75634]:   <os>
Nov 15 18:42:13 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:13 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:13 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:13 user nova-compute[75634]:   </os>
Nov 15 18:42:13 user nova-compute[75634]:   <features>
Nov 15 18:42:13 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:13 user nova-compute[75634]:     <apic/>
Nov 15 18:42:13 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:13 user nova-compute[75634]:   </features>
Nov 15 18:42:13 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:13 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:13 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:13 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:13 user nova-compute[75634]:   </clock>
Nov 15 18:42:13 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:13 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:13 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:13 user nova-compute[75634]:   </cpu>
Nov 15 18:42:13 user nova-compute[75634]:   <devices>
Nov 15 18:42:13 user nova-compute[75634]:     <disk type="file" device="cdrom">
Nov 15 18:42:13 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 18:42:13 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/disk.config"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="hda" bus="ide"/>
Nov 15 18:42:13 user nova-compute[75634]:     </disk>
Nov 15 18:42:13 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:42:13 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:13 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <serial>4b748e78-8493-4094-9998-8a01593cba8d</serial>
Nov 15 18:42:13 user nova-compute[75634]:     </disk>
Nov 15 18:42:13 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:42:13 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:13 user nova-compute[75634]:       <source dev="/dev/sde"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <serial>2f7b487c-336e-4afd-a5d5-d07dda4250be</serial>
Nov 15 18:42:13 user nova-compute[75634]:     </disk>
Nov 15 18:42:13 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:42:13 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:13 user nova-compute[75634]:       <source dev="/dev/sdf"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="vdc" bus="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <serial>3bd95688-205a-4af6-83a2-9ec8ac5db977</serial>
Nov 15 18:42:13 user nova-compute[75634]:     </disk>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:f6:3f:a9"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tapd6c2806f-36"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:af:86:fb"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tap9c335e11-f8"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:dc:5b:e8"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tapc259b69f-6a"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:3d:09:4d"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tap0b292661-41"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:13:71:ea"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tap057a5bf9-46"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:f5:c3:b9"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tapd72f5027-30"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:13 user nova-compute[75634]:       <mac address="fa:16:3e:28:5e:93"/>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:13 user nova-compute[75634]:       <target dev="tapa218593a-e2"/>
Nov 15 18:42:13 user nova-compute[75634]:     </interface>
Nov 15 18:42:13 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:13 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/console.log" append="off"/>
Nov 15 18:42:13 user nova-compute[75634]:     </serial>
Nov 15 18:42:13 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:13 user nova-compute[75634]:     <video>
Nov 15 18:42:13 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:13 user nova-compute[75634]:     </video>
Nov 15 18:42:13 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:13 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:13 user nova-compute[75634]:     </rng>
Nov 15 18:42:13 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:13 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:13 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:13 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:13 user nova-compute[75634]:   </devices>
Nov 15 18:42:13 user nova-compute[75634]: </domain>
Nov 15 18:42:13 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11d811bb-5d0f-5a8f-bdd4-aee0d6a92f02', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c2806f-36, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c2806f-36, col_values=(('qos', UUID('e9c32168-df7a-4f15-a9c6-eb70cf0148d9')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c2806f-36, col_values=(('external_ids', {'iface-id': 'd6c2806f-364a-4af9-a63a-f05271d7bf06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:3f:a9', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36')
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8337222-4ac4-57c6-a110-605ce1f30a09', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c335e11-f8, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c335e11-f8, col_values=(('qos', UUID('3a664454-c4c3-4489-ad49-34d8a4e42567')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c335e11-f8, col_values=(('external_ids', {'iface-id': '9c335e11-f89c-4856-9374-7498e2c1a93d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:86:fb', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8')
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df6d5fc4-9a97-58f9-afbb-320b4234af75', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk 1073741824" returned: 0 in 0.056s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc259b69f-6a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc259b69f-6a, col_values=(('qos', UUID('b4acab4a-e456-4753-84e7-3f0c82419cd3')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc259b69f-6a, col_values=(('external_ids', {'iface-id': 'c259b69f-6a94-4872-a9e7-ddd5a7934263', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:5b:e8', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a')
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbf8d910-1133-5b4e-9af9-c2f4bb54283f', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b292661-41, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b292661-41, col_values=(('qos', UUID('4c2fb9a1-1d7f-46aa-a419-8306bdedd3eb')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b292661-41, col_values=(('external_ids', {'iface-id': '0b292661-4105-4170-8c61-337f9138a0b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:09:4d', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41')
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e8e9758-5d2f-5049-84d3-a1f6ed146a4a', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.216s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057a5bf9-46, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057a5bf9-46, col_values=(('qos', UUID('ca8a7e21-1035-4196-bb97-14f3b71ad235')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057a5bf9-46, col_values=(('external_ids', {'iface-id': '057a5bf9-46aa-4a7f-9b62-dd416a745484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:71:ea', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46')
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b3e2592-5064-5e1d-a312-eaa9174cfddf', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Cannot resize image /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Ensure instance console log exists: /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd72f5027-30, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd72f5027-30, col_values=(('qos', UUID('bbd97c28-3152-49bc-8c33-72e026335de6')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd72f5027-30, col_values=(('external_ids', {'iface-id': 'd72f5027-30d7-44f7-8d0e-36ceeb9526d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c3:b9', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30')
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4a7341f-dbc6-5863-8522-895b51eb4462', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa218593a-e2, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa218593a-e2, col_values=(('qos', UUID('263bef41-8c9f-4808-8a4d-1ccf478b4520')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa218593a-e2, col_values=(('external_ids', {'iface-id': 'a218593a-e2e1-4c5f-abef-f5a59ea29f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:5e:93', 'vm-uuid': '4548ea11-be1d-4c8c-b3a3-31b5ad0c6765'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_vif [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2')
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] No BDM found with device name hda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] No VIF found with MAC fa:16:3e:f6:3f:a9, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] No VIF found with MAC fa:16:3e:13:71:ea, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Using config drive
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Successfully created port: 375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:42:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Creating config drive at /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/disk.config
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi4bdx7b2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:14 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:14 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:14 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi4bdx7b2" returned: 0 in 0.087s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[813af106-47a8-4b9e-bbbf-0403f636eb09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:15 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[690817af-43ad-405c-b02a-d44a72e9ba0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2] added
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.134s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[88048c68-c67c-4e0f-ba16-2814bf49553d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e097f-edd3-4e1d-add6-97cfabee0edd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWNvGSdZ {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWNvGSdZ" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8634f8-951d-442f-b36b-e6023e57a167]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWNvGSdZ'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6857c52-c2a0-4785-bcde-bc08b10d71b0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4636089e-66e2-414b-8d30-b141451ce2ab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6766f2-7a01-4291-998e-71aa2c4a2a6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]
Nov 15 18:42:15 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56affe-0cd5-4df3-bf1d-ab11cc14cb8a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc722a2e-403d-4628-9af2-7e05920bb022]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.475s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86631c9-6347-4a07-986c-7d0ea8d85c81]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Successfully updated port: 375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquired lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing instance network info cache due to event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] Acquiring lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Releasing lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Instance network_info: |[{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] Acquired lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.neutron [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Start _get_guest_xml network_info=[{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1678264282',display_name='tempest-TestStampPattern-server-1678264282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1678264282',id=21,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-pdog9ym3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:13Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=e76c80e0-0538-428d-bd3c-07985d8205cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'pci_devices' on Instance uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:16 user nova-compute[75634]:   <uuid>e76c80e0-0538-428d-bd3c-07985d8205cc</uuid>
Nov 15 18:42:16 user nova-compute[75634]:   <name>instance-00000015</name>
Nov 15 18:42:16 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:16 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:16 user nova-compute[75634]:   <metadata>
Nov 15 18:42:16 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:16 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:name>tempest-TestStampPattern-server-1678264282</nova:name>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:15</nova:creationTime>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:16 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:16 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:user uuid="d17a4320e9264810ba96eba3fcd707cf">tempest-TestStampPattern-326822497-project-member</nova:user>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:project uuid="8eff43206fc5450ebe346f72798856f9">tempest-TestStampPattern-326822497</nova:project>
Nov 15 18:42:16 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:16 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:16 user nova-compute[75634]:         <nova:port uuid="375588ad-c15b-41ec-8f04-6d08236bbcfe">
Nov 15 18:42:16 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 18:42:16 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:16 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:16 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:16 user nova-compute[75634]:   </metadata>
Nov 15 18:42:16 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:16 user nova-compute[75634]:     <system>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="serial">e76c80e0-0538-428d-bd3c-07985d8205cc</entry>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="uuid">e76c80e0-0538-428d-bd3c-07985d8205cc</entry>
Nov 15 18:42:16 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:16 user nova-compute[75634]:     </system>
Nov 15 18:42:16 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:16 user nova-compute[75634]:   <os>
Nov 15 18:42:16 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:16 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:16 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:16 user nova-compute[75634]:   </os>
Nov 15 18:42:16 user nova-compute[75634]:   <features>
Nov 15 18:42:16 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:16 user nova-compute[75634]:     <apic/>
Nov 15 18:42:16 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:16 user nova-compute[75634]:   </features>
Nov 15 18:42:16 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:16 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:16 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:16 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:16 user nova-compute[75634]:   </clock>
Nov 15 18:42:16 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:16 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:16 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:16 user nova-compute[75634]:   </cpu>
Nov 15 18:42:16 user nova-compute[75634]:   <devices>
Nov 15 18:42:16 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:42:16 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:42:16 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk"/>
Nov 15 18:42:16 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:16 user nova-compute[75634]:     </disk>
Nov 15 18:42:16 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:16 user nova-compute[75634]:       <mac address="fa:16:3e:93:dc:1d"/>
Nov 15 18:42:16 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:16 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:16 user nova-compute[75634]:       <target dev="tap375588ad-c1"/>
Nov 15 18:42:16 user nova-compute[75634]:     </interface>
Nov 15 18:42:16 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:16 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/console.log" append="off"/>
Nov 15 18:42:16 user nova-compute[75634]:     </serial>
Nov 15 18:42:16 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:16 user nova-compute[75634]:     <video>
Nov 15 18:42:16 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:16 user nova-compute[75634]:     </video>
Nov 15 18:42:16 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:16 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:16 user nova-compute[75634]:     </rng>
Nov 15 18:42:16 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:16 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:16 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:16 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:16 user nova-compute[75634]:   </devices>
Nov 15 18:42:16 user nova-compute[75634]: </domain>
Nov 15 18:42:16 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1678264282',display_name='tempest-TestStampPattern-server-1678264282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1678264282',id=21,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-pdog9ym3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:13Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=e76c80e0-0538-428d-bd3c-07985d8205cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG os_vif [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed07f812-da5b-5ca9-a25c-f8dd70349073', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap375588ad-c1, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap375588ad-c1, col_values=(('qos', UUID('b43ee9ae-28f0-4dc9-890d-d61fedeb4a4e')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap375588ad-c1, col_values=(('external_ids', {'iface-id': '375588ad-c15b-41ec-8f04-6d08236bbcfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:dc:1d', 'vm-uuid': 'e76c80e0-0538-428d-bd3c-07985d8205cc'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: INFO os_vif [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1')
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No VIF found with MAC fa:16:3e:93:dc:1d, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updated VIF entry in instance network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d62fda12-3dd3-40af-a866-97f7e9f55a16 req-18b6a099-4921-443d-9ad0-16f7efff1c69 service nova] Releasing lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Port 3788bac0-17f5-41ed-889d-2649ea453783 binding to destination host user is already ACTIVE {{(pid=75634) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.542s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== connect_volume: return (1544ms) {'type': 'block', 'scsi_wwn': '23439636266646664', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439636266646664', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'flavor' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:42:16 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:16 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:42:16 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:42:16 user nova-compute[75634]:   <serial>adc5a166-a8c2-4e98-aae8-2a643ca432a2</serial>
Nov 15 18:42:16 user nova-compute[75634]: </disk>
Nov 15 18:42:16 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Creating tmpfile /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/tmpyahvss8y to verify with other compute node that the instance is on the same shared storage. {{(pid=75634) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:95:33:70, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f28a2609-b769-4a36-ac9c-0c8692501202 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.353s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:17 user nova-compute[75634]: WARNING nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 for instance with vm_state building and task_state spawning.
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:17 user nova-compute[75634]: WARNING nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 for instance with vm_state building and task_state spawning.
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:17 user nova-compute[75634]: WARNING nova.compute.manager [req-3893c6ba-d210-4c76-aeee-4a85779fbd47 req-7e7437ae-00dc-4c40-8fb2-caa8f3ba9543 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state resized and task_state resize_reverting.
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: INFO nova.compute.manager [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Rebuilding instance
Nov 15 18:42:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance destroyed successfully.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'resources' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3788bac0-17, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state resized and task_state resize_reverting.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING nova.compute.manager [req-2dd18504-f099-4469-a074-cde5b3b2ccf1 req-85b60717-7323-4386-8859-4eebf887c68d service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 for instance with vm_state building and task_state spawning.
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6933efe4-5835-4ff9-8975-2704b188616a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:19 user nova-compute[75634]: INFO os_vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:42:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:19 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5265ee-c517-47fc-99e8-87c96bf18687]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:42:19 user nova-compute[75634]: No targets found.
Nov 15 18:42:19 user nova-compute[75634]: iSNS:
Nov 15 18:42:19 user nova-compute[75634]: No targets found.
Nov 15 18:42:19 user nova-compute[75634]: STATIC:
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:42:19 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:19 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:19 user nova-compute[75634]: FIRMWARE:
Nov 15 18:42:19 user nova-compute[75634]: No targets found.
Nov 15 18:42:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:42:19 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:42:19 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25bdb9-167c-464e-b69b-8949c2a668ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e23e0f5-590e-426c-8a29-70580af8aa88]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:20 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4433dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b31a10-beb7-49cd-aaab-e63966a20121]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ce9ec9-da49-4a58-adc4-dba820d69916]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b46ec-869a-47de-b353-1fbd40961690]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cdae34-1219-49db-a7e0-f61f24ea7342]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4039f6b-3b89-4047-9082-c28a62cc14f0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a6fc2e-54f1-412b-b8e8-0719657a13a0]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:42:20 user nova-compute[75634]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995dc5a-e0ba-4ee9-a3a5-caf8fecac9e4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== disconnect_volume: return (447ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:20 user nova-compute[75634]: WARNING nova.compute.manager [req-9961696b-f3ea-471d-9af7-d8e577602138 req-23908e7c-df5b-4aca-a6a2-dfd5ebc62c40 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a for instance with vm_state building and task_state spawning.
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:20 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:42:20 user nova-compute[75634]: INFO nova.compute.claims [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Claim successful on node user
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance destroyed successfully.
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: INFO nova.compute.manager [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Detaching volume adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:42:21 user nova-compute[75634]: INFO nova.virt.block_device [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attempting to driver detach volume adc5a166-a8c2-4e98-aae8-2a643ca432a2 from mountpoint /dev/vdb
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Attempting to detach device vdb from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:42:21 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:21 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:42:21 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:42:21 user nova-compute[75634]:   <serial>adc5a166-a8c2-4e98-aae8-2a643ca432a2</serial>
Nov 15 18:42:21 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:42:21 user nova-compute[75634]: </disk>
Nov 15 18:42:21 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:42:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully detached device vdb from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the persistent domain config.
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:21 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[620492b8-caab-4fd9-bb85-ba4114d855ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:42:21 user nova-compute[75634]: No targets found.
Nov 15 18:42:21 user nova-compute[75634]: iSNS:
Nov 15 18:42:21 user nova-compute[75634]: No targets found.
Nov 15 18:42:21 user nova-compute[75634]: STATIC:
Nov 15 18:42:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:42:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:42:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:42:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:42:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:42:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:21 user nova-compute[75634]: FIRMWARE:
Nov 15 18:42:21 user nova-compute[75634]: No targets found.
Nov 15 18:42:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:42:21 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:42:21 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321cfdc-cbda-4ef3-96e5-3e35d41c1f35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4e619-16f3-46e0-9523-0c61bd9bba96]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:21 user nova-compute[75634]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b687093f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:21 user nova-compute[75634]: WARNING nova.compute.manager [req-5c484e36-1a4b-4bb3-8a88-d81aa2c89954 req-68d92341-0420-49aa-8fea-b620f1735b4c service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d for instance with vm_state building and task_state spawning.
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[88386bde-6c93-45c9-88e8-962e8c00c696]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e7ce8-8b13-430d-841b-2f2959212bf2]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527c717-a06e-4b11-96ff-102bfcad6f43]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'migration_context' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcf9964-adfd-4e64-aefd-9f4a17963c1e]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.policy [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c762423a7fe4402d9dbab33db79a2430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f09d0a58c4138b5b95ce2516e7882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:21 user nova-compute[75634]: WARNING nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 for instance with vm_state building and task_state spawning.
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:21 user nova-compute[75634]: WARNING nova.compute.manager [req-c0dcff84-c136-4e2b-884f-603b1af3a5b3 req-e3457e57-8da2-474a-813c-159b61a204bc service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 for instance with vm_state building and task_state spawning.
Nov 15 18:42:21 user nova-compute[75634]: DEBUG nova.objects.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Object Instance<46998ac1-8bf2-4277-a9cd-f8ecf53c5576> lazy-loaded attributes: resources,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef0cb9-2882-4dbe-ad89-2f456dcd5242]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adf432a-b60a-4a18-95fb-a0d6f3db08da]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]
Nov 15 18:42:22 user nova-compute[75634]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:42:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Creating image(s)
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "/opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "/opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da0e62-8b2d-45d2-9fb1-e3ec34139ecd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.534s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== disconnect_volume: return (535ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.251s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.272s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk 1073741824" returned: 0 in 0.107s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Successfully created port: b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.323s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a for instance with vm_state building and task_state spawning.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] No waiting events found dispatching network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received unexpected event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe for instance with vm_state building and task_state spawning.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] No waiting events found dispatching network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-2938630a-ffc5-4ee0-9bd9-5f6c1ed0823f req-e730ef3c-809f-4a92-8ee8-dc868373f5c2 service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received unexpected event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe for instance with vm_state building and task_state spawning.
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.compute.manager [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Terminating instance
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.409s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance destroyed successfully.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-ServerActionsTestOtherA-server-470214741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0727a542-fa, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Cannot resize image /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Ensure instance console log exists: /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de2dd6ab-a0c9-48ac-982c-1b75b281b56a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:23 user nova-compute[75634]: INFO os_vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa')
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb01695-bdbc-4a30-92b6-46358340a118]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:42:23 user nova-compute[75634]: No targets found.
Nov 15 18:42:23 user nova-compute[75634]: iSNS:
Nov 15 18:42:23 user nova-compute[75634]: No targets found.
Nov 15 18:42:23 user nova-compute[75634]: STATIC:
Nov 15 18:42:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:42:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:42:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:42:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:42:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:23 user nova-compute[75634]: FIRMWARE:
Nov 15 18:42:23 user nova-compute[75634]: No targets found.
Nov 15 18:42:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:42:23 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:42:23 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d67c26-f06b-4d4d-a857-4a952efad743]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2aa17-7443-4b69-889e-c2e1990499de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:23 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4433c3a0>, {}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Disconnecting from: [] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== disconnect_volume: return (86ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Deleting instance files /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d_del
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Deletion of /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d_del complete
Nov 15 18:42:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.compute.manager [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Swapping old allocation on dict_keys(['505e734b-a7a7-4ad8-9307-19cae75d31aa']) held by migration 175b171e-3581-4a55-a5ab-9d5a4202f45a for instance
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Overwriting current allocation {'allocations': {'505e734b-a7a7-4ad8-9307-19cae75d31aa': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': '7bed672b3528475bb3bbe7f4eecfd7c5', 'user_id': '32a76663d88d4a4ea090919a67c801a8', 'consumer_generation': 1} on consumer 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d for instance with vm_state building and task_state spawning.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state active and task_state rebuilding.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:23 user nova-compute[75634]: WARNING nova.compute.manager [req-e0e4268d-d8df-4e3b-90b0-c18b7d90fca1 req-ea3325a1-b61b-4595-b698-7fadf62f57a6 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state active and task_state rebuilding.
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.block_device [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Booting with volume adc5a166-a8c2-4e98-aae8-2a643ca432a2 at /dev/vdb
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance spawned successfully.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG os_brick.utils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a181811-a00a-450b-8632-c850ee8ba821]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Took 15.20 seconds to spawn the instance on the hypervisor.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Successfully updated port: b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d36436-35ae-4eb1-bde7-f3d174a61a40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Instance spawned successfully.
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb9366-fa82-4aac-b1ba-1bebbe239012]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquired lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eda19c-9592-47a4-aef2-528a1b759646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:24 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517130a-03fd-4f13-b9bc-494f5f2a94e7]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.utils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== get_connector_properties: return (218ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating existing volume attachment record: 7251dd4a-3d0c-4340-a98b-5b21244fe638 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Instance destroyed successfully.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.objects.instance [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lazy-loading 'resources' on Instance uuid fc102a8d-d379-40c7-9b38-ed423ee1a5c7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.compute.manager [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Took 34.31 seconds to build instance.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1840089197',display_name='tempest-VolumesAdminNegativeTest-server-1840089197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1840089197',id=5,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ04i4SEsmj6H1udZSBVW7MTdsmBlDiT6HKHsjP/3V+znzkxjVdplK2G4dHNNlDptWnSMx8HD5wHyAaghAKtBEfO3dBB0zqJOlXzePTtpfGxixxD0Ds8ik29/cUpOIJow==',key_name='tempest-keypair-1976255953',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3250b3723c8a4a1db318035e0a7477df',ramdisk_id='',reservation_id='r-32njrp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-671222403',owner_user_name='tempest-VolumesAdminNegativeTest-671222403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a3dc42740164b32b830f419a10be05e',uuid=fc102a8d-d379-40c7-9b38-ed423ee1a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converting VIF {"id": "711c0187-65d5-4792-bb1c-1d7da8200967", "address": "fa:16:3e:09:a7:2f", "network": {"id": "ce1ed79f-1b9a-43e6-b421-98470c254b5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1402391622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3250b3723c8a4a1db318035e0a7477df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711c0187-65", "ovs_interfaceid": "711c0187-65d5-4792-bb1c-1d7da8200967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_vif [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap711c0187-65, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f41953e9-0151-485a-a01c-7225c94b3851) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-392c42a0-44c5-49af-9e6d-b8eed0170a82 tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.492s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Took 11.03 seconds to spawn the instance on the hypervisor.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:24 user nova-compute[75634]: INFO os_vif [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:a7:2f,bridge_name='br-int',has_traffic_filtering=True,id=711c0187-65d5-4792-bb1c-1d7da8200967,network=Network(ce1ed79f-1b9a-43e6-b421-98470c254b5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711c0187-65')
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Deleting instance files /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7_del
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Deletion of /opt/stack/data/nova/instances/fc102a8d-d379-40c7-9b38-ed423ee1a5c7_del complete
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.compute.manager [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:42:24 user nova-compute[75634]: INFO nova.compute.manager [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Took 12.06 seconds to build instance.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1f4d568b-9593-4f4b-a3ba-67ac1d59b070 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.212s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Releasing lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Instance network_info: |[{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Start _get_guest_xml network_info=[{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-15638943',display_name='tempest-SnapshotDataIntegrityTests-server-15638943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-15638943',id=22,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI65ipEb6a1VEm1DwhC/vVNwqYuRxq3GdpGYTi2M4CU81qkzcHmWv+K0zJAGWYTLSVc/wvpnEoV0aGcNOQXyyAL4shvvCR5sNaPP24pPyuGYnCEAIX/bRYCggXcMG6vv1A==',key_name='tempest-keypair-1202929257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799f09d0a58c4138b5b95ce2516e7882',ramdisk_id='',reservation_id='r-rbzhyxk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-561763178',owner_user_name='tempest-SnapshotDataIntegrityTests-561763178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c762423a7fe4402d9dbab33db79a2430',uuid=c3535e09-0311-41cf-b9f7-c181174bd44f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converting VIF {"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'pci_devices' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:24 user nova-compute[75634]:   <uuid>c3535e09-0311-41cf-b9f7-c181174bd44f</uuid>
Nov 15 18:42:24 user nova-compute[75634]:   <name>instance-00000016</name>
Nov 15 18:42:24 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:24 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:24 user nova-compute[75634]:   <metadata>
Nov 15 18:42:24 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:24 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-15638943</nova:name>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:24</nova:creationTime>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:24 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:24 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:user uuid="c762423a7fe4402d9dbab33db79a2430">tempest-SnapshotDataIntegrityTests-561763178-project-member</nova:user>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:project uuid="799f09d0a58c4138b5b95ce2516e7882">tempest-SnapshotDataIntegrityTests-561763178</nova:project>
Nov 15 18:42:24 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:24 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:24 user nova-compute[75634]:         <nova:port uuid="b7a2603a-84df-4520-b566-40a45cee4337">
Nov 15 18:42:24 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 18:42:24 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:24 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:24 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:24 user nova-compute[75634]:   </metadata>
Nov 15 18:42:24 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:24 user nova-compute[75634]:     <system>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="serial">c3535e09-0311-41cf-b9f7-c181174bd44f</entry>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="uuid">c3535e09-0311-41cf-b9f7-c181174bd44f</entry>
Nov 15 18:42:24 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:24 user nova-compute[75634]:     </system>
Nov 15 18:42:24 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:24 user nova-compute[75634]:   <os>
Nov 15 18:42:24 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:24 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:24 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:24 user nova-compute[75634]:   </os>
Nov 15 18:42:24 user nova-compute[75634]:   <features>
Nov 15 18:42:24 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:24 user nova-compute[75634]:     <apic/>
Nov 15 18:42:24 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:24 user nova-compute[75634]:   </features>
Nov 15 18:42:24 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:24 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:24 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:24 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:24 user nova-compute[75634]:   </clock>
Nov 15 18:42:24 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:24 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:24 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:24 user nova-compute[75634]:   </cpu>
Nov 15 18:42:24 user nova-compute[75634]:   <devices>
Nov 15 18:42:24 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:42:24 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:42:24 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk"/>
Nov 15 18:42:24 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:24 user nova-compute[75634]:     </disk>
Nov 15 18:42:24 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:24 user nova-compute[75634]:       <mac address="fa:16:3e:5c:a4:b0"/>
Nov 15 18:42:24 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:24 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:24 user nova-compute[75634]:       <target dev="tapb7a2603a-84"/>
Nov 15 18:42:24 user nova-compute[75634]:     </interface>
Nov 15 18:42:24 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:24 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/console.log" append="off"/>
Nov 15 18:42:24 user nova-compute[75634]:     </serial>
Nov 15 18:42:24 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:24 user nova-compute[75634]:     <video>
Nov 15 18:42:24 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:24 user nova-compute[75634]:     </video>
Nov 15 18:42:24 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:24 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:24 user nova-compute[75634]:     </rng>
Nov 15 18:42:24 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:24 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:24 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:24 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:24 user nova-compute[75634]:   </devices>
Nov 15 18:42:24 user nova-compute[75634]: </domain>
Nov 15 18:42:24 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-15638943',display_name='tempest-SnapshotDataIntegrityTests-server-15638943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-15638943',id=22,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI65ipEb6a1VEm1DwhC/vVNwqYuRxq3GdpGYTi2M4CU81qkzcHmWv+K0zJAGWYTLSVc/wvpnEoV0aGcNOQXyyAL4shvvCR5sNaPP24pPyuGYnCEAIX/bRYCggXcMG6vv1A==',key_name='tempest-keypair-1202929257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799f09d0a58c4138b5b95ce2516e7882',ramdisk_id='',reservation_id='r-rbzhyxk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-561763178',owner_user_name='tempest-SnapshotDataIntegrityTests-561763178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c762423a7fe4402d9dbab33db79a2430',uuid=c3535e09-0311-41cf-b9f7-c181174bd44f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converting VIF {"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_vif [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b74934c-8d0a-5b5d-8afa-318b3257d056', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.utils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7a2603a-84, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7a2603a-84, col_values=(('qos', UUID('354fe746-4ded-44db-ab2c-fdae14d39bb8')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7a2603a-84, col_values=(('external_ids', {'iface-id': 'b7a2603a-84df-4520-b566-40a45cee4337', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a4:b0', 'vm-uuid': 'c3535e09-0311-41cf-b9f7-c181174bd44f'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b684b1-1f1d-40af-be41-de34ec38e9c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:24 user nova-compute[75634]: INFO os_vif [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84')
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f387b307-993f-492b-9036-3e5c5e5b00cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2509a4f3-c6d8-4104-b638-673e73f44e1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388118a-4642-4718-ae0f-50b0f6964102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:24 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[31083c75-5030-4b29-b506-41fe80ea6787]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG os_brick.utils [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No VIF found with MAC fa:16:3e:5c:a4:b0, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-unplugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] No waiting events found dispatching network-vif-unplugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-unplugged-711c0187-65d5-4792-bb1c-1d7da8200967 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Acquiring lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] No waiting events found dispatching network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:25 user nova-compute[75634]: WARNING nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received unexpected event network-vif-plugged-711c0187-65d5-4792-bb1c-1d7da8200967 for instance with vm_state active and task_state deleting.
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-changed-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Refreshing instance network info cache due to event network-changed-b7a2603a-84df-4520-b566-40a45cee4337. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Acquiring lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Acquired lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Refreshing network info cache for port b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:25 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Took 0.92 seconds to deallocate network for instance.
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-ef3d52c1-f40c-4296-96a7-ffccc0088ecb req-f90ce709-7978-45e0-ac53-1a5be3796e2f service nova] [instance: fc102a8d-d379-40c7-9b38-ed423ee1a5c7] Received event network-vif-deleted-711c0187-65d5-4792-bb1c-1d7da8200967 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updated VIF entry in instance network info cache for port b7a2603a-84df-4520-b566-40a45cee4337. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-12355a2b-80f0-4a72-81d5-bdab27dd97c0 req-abc73f9e-d641-4de6-80bb-3dd70b26aed3 service nova] Releasing lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:26 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'e8988672-a7d0-4098-8f85-4fc83584da4d' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e8988672-a7d0-4098-8f85-4fc83584da4d' (instance-0000000f)
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:26 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Deleted allocations for instance fc102a8d-d379-40c7-9b38-ed423ee1a5c7
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-33714d8e-662d-4209-b6fe-9337ab29e7b9 tempest-VolumesAdminNegativeTest-671222403 tempest-VolumesAdminNegativeTest-671222403-project-member] Lock "fc102a8d-d379-40c7-9b38-ed423ee1a5c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] No waiting events found dispatching network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:26 user nova-compute[75634]: WARNING nova.compute.manager [req-dca1a0fa-b3a9-4be4-bdfc-41afb82bed15 req-7109149c-d2e4-4452-9ee7-38f917ffdeab service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received unexpected event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 for instance with vm_state building and task_state spawning.
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:29 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 is timed out.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-changed-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Refreshing instance network info cache due to event network-changed-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] Acquiring lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] Acquired lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Refreshing network info cache for port 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] No waiting events found dispatching network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:29 user nova-compute[75634]: WARNING nova.compute.manager [req-2adee41b-e421-4868-b325-441aed431fd2 req-38136e26-d457-4d99-a9b3-a5b1444a2056 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received unexpected event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 for instance with vm_state building and task_state spawning.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully detached device vdc from instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 from the live domain config.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lazy-loading 'flavor' on Instance uuid f1e387c8-c2b7-4b3f-bef5-67a629090c72 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Instance spawned successfully.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZmTYVHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:29 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:29 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:29 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.328105926513672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb57009-e0c8-446e-a583-5a0fc539550d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:42:29 user nova-compute[75634]: No targets found.
Nov 15 18:42:29 user nova-compute[75634]: iSNS:
Nov 15 18:42:29 user nova-compute[75634]: No targets found.
Nov 15 18:42:29 user nova-compute[75634]: STATIC:
Nov 15 18:42:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:42:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:42:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:42:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab
Nov 15 18:42:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:29 user nova-compute[75634]: FIRMWARE:
Nov 15 18:42:29 user nova-compute[75634]: No targets found.
Nov 15 18:42:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:42:29 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:42:29 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c35598-ddec-4ed4-a080-a7cdbb9d6125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354bc1b-3930-4bf7-9a8f-ae30b6e2679d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:29 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44310ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: INFO nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[08339f93-884f-40f7-9fa8-96c4303c3a93]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53b119-ef57-480f-917d-9828a263e099]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ccb4ce-1ebb-43de-b1f7-6d2ef7c3ae29]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d14a0c65-0ba1-4919-80b8-5295e100a7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f1e387c8-c2b7-4b3f-bef5-67a629090c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance aa6bb849-3c0b-4ee5-9851-853c7cad944d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 54932a79-b9a3-4735-a317-a4b2b5a38443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eede0cc-2bdd-4311-9609-79bcedfc05e2]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:29 user nova-compute[75634]: INFO nova.compute.manager [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Attaching volume c7e6e2ae-37da-479d-9d5d-8fa70c80028c to /dev/vdb
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: INFO nova.compute.manager [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Took 8.81 seconds to build instance.
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[858144a9-31d2-4928-b851-bcd29bdeecb5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c796a60e-f3e1-4502-af2e-753e29fcc482 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.952s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b414e30-441c-4df0-9ea7-18dd8fa1b62e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260]
Nov 15 18:42:29 user nova-compute[75634]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd31c717-2bda-4b3c-9060-420540e282ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa6d9d2-6759-41a8-b653-00a1458b99eb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.580s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] <== disconnect_volume: return (583ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG os_brick.utils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[09842294-29c9-4aa2-b2b6-2b88572ad136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd42a3-e497-46c3-a85f-54f616b27a98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071e7d2-f2d4-4d9c-b152-8eeac62d8758]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ab720-cdc0-45b9-b76d-286f06a549c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:30 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7867ba17-be08-49fe-8c9e-81102bc33d0e]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updated VIF entry in instance network info cache for port 8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updating instance_info_cache with network_info: [{"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG os_brick.utils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] <== get_connector_properties: return (314ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Updating existing volume attachment record: c4bec617-4506-4146-bcf6-f17ea7c57622 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-21177abb-4a87-4746-bc2a-5974e4341d91 req-464c578e-21f9-414f-bd14-8d340d34f87a service nova] Releasing lock "refresh_cache-aa6bb849-3c0b-4ee5-9851-853c7cad944d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.239s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.180s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'flavor' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e5917201-38d1-4f03-9f4d-2562514b04c1 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.874s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:42:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Creating image(s)
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:31 user nova-compute[75634]: INFO nova.compute.manager [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Attaching volume 05d4860c-b031-4cca-8210-4dad1ac07ab0 to /dev/vdb
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c406d-afc1-4376-bb2c-19a7ef20510c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Starting finish_revert_migration {{(pid=75634) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd994219-ab68-4ea2-8613-ced383abb250]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.252s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fed88a-d320-4a8a-ba09-f57c496f4b5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start _get_guest_xml network_info=[{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '46998ac1-8bf2-4277-a9cd-f8ecf53c5576', 'attached_at': '2023-11-15T18:42:31.000000', 'detached_at': '', 'volume_id': '599af8bc-18bc-4b32-90ca-ae1a5443109a', 'serial': '599af8bc-18bc-4b32-90ca-ae1a5443109a'}, 'guest_format': None, 'boot_index': None, 'attachment_id': '9bd1b876-30a1-42a0-bf9f-aeb782f4afee', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff5d18-e17d-4a74-bc9b-b8950f493cea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:42:31 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2a1ea2-995d-4ba1-b17f-63de4cb86148]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== get_connector_properties: return (240ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updating existing volume attachment record: e84a3c2d-4b32-47c7-bf2d-b415bc4645aa {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:31 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk 1073741824" returned: 0 in 0.118s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[27913e73-d13e-42a7-94b4-e1f528cac7c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:31 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ff04c-da94-40c0-bf05-6738f00b226f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a] added
Nov 15 18:42:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1b938c-b0f8-408f-b7dd-2d2236285d5d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[03234556-4a0a-4822-890c-d87ee01f1f37]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UevkjIJF" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[84431269-b10d-45aa-ab3c-fab439be5f02]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UevkjIJF'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f651f3-d50a-46f1-b6a0-e7337c691e6f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[670f69f4-9ad6-42bf-9303-02114ac781d7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:31 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:31 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:31 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:31 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c651f1a-d3e3-4a3e-a5df-06cb37965fad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:42:32 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad0a35-1ce3-4f3e-a7f6-15e8a7ceace1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Cannot resize image /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Ensure instance console log exists: /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start _get_guest_xml network_info=[{"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8988672-a7d0-4098-8f85-4fc83584da4d', 'attached_at': '', 'detached_at': '', 'volume_id': 'adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'serial': 'adc5a166-a8c2-4e98-aae8-2a643ca432a2'}, 'guest_format': None, 'boot_index': None, 'attachment_id': '7251dd4a-3d0c-4340-a98b-5b21244fe638', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97330f-dcaf-4707-bacb-ac626c8b4644]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:32 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.504s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 18:42:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a09a6-55b0-4f96-a90e-79554b68c16d]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:32 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:42:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== connect_volume: return (1558ms) {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637636231636163', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.956s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:33 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:33 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931c878-a12e-4315-a633-2931233ca039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:33 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:33 user nova-compute[75634]:   <uuid>46998ac1-8bf2-4277-a9cd-f8ecf53c5576</uuid>
Nov 15 18:42:33 user nova-compute[75634]:   <name>instance-00000003</name>
Nov 15 18:42:33 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:33 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:33 user nova-compute[75634]:   <metadata>
Nov 15 18:42:33 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:33 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherB-server-2001600215</nova:name>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:31</nova:creationTime>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:33 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:33 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:user uuid="32a76663d88d4a4ea090919a67c801a8">tempest-ServerActionsTestOtherB-1858282954-project-member</nova:user>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:project uuid="7bed672b3528475bb3bbe7f4eecfd7c5">tempest-ServerActionsTestOtherB-1858282954</nova:project>
Nov 15 18:42:33 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:33 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:33 user nova-compute[75634]:         <nova:port uuid="3788bac0-17f5-41ed-889d-2649ea453783">
Nov 15 18:42:33 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:42:33 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:33 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:33 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:33 user nova-compute[75634]:   </metadata>
Nov 15 18:42:33 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:33 user nova-compute[75634]:     <system>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="serial">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="uuid">46998ac1-8bf2-4277-a9cd-f8ecf53c5576</entry>
Nov 15 18:42:33 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:33 user nova-compute[75634]:     </system>
Nov 15 18:42:33 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:33 user nova-compute[75634]:   <os>
Nov 15 18:42:33 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:33 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:33 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:33 user nova-compute[75634]:   </os>
Nov 15 18:42:33 user nova-compute[75634]:   <features>
Nov 15 18:42:33 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:33 user nova-compute[75634]:     <apic/>
Nov 15 18:42:33 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:33 user nova-compute[75634]:   </features>
Nov 15 18:42:33 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:33 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:33 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:33 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:33 user nova-compute[75634]:   </clock>
Nov 15 18:42:33 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:33 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:33 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:33 user nova-compute[75634]:   </cpu>
Nov 15 18:42:33 user nova-compute[75634]:   <devices>
Nov 15 18:42:33 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:42:33 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:42:33 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk"/>
Nov 15 18:42:33 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:33 user nova-compute[75634]:     </disk>
Nov 15 18:42:33 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:42:33 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:33 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:42:33 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:42:33 user nova-compute[75634]:       <serial>599af8bc-18bc-4b32-90ca-ae1a5443109a</serial>
Nov 15 18:42:33 user nova-compute[75634]:     </disk>
Nov 15 18:42:33 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:33 user nova-compute[75634]:       <mac address="fa:16:3e:96:86:92"/>
Nov 15 18:42:33 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:33 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:33 user nova-compute[75634]:       <target dev="tap3788bac0-17"/>
Nov 15 18:42:33 user nova-compute[75634]:     </interface>
Nov 15 18:42:33 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:33 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/console.log" append="off"/>
Nov 15 18:42:33 user nova-compute[75634]:     </serial>
Nov 15 18:42:33 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:33 user nova-compute[75634]:     <video>
Nov 15 18:42:33 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:33 user nova-compute[75634]:     </video>
Nov 15 18:42:33 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:33 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:33 user nova-compute[75634]:     </rng>
Nov 15 18:42:33 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:33 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:33 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:33 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:33 user nova-compute[75634]:   </devices>
Nov 15 18:42:33 user nova-compute[75634]: </domain>
Nov 15 18:42:33 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0842a59d-f386-46d8-b518-b0733929917b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2] added
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50831446-03e2-5796-952a-8afb1664d053', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3788bac0-17, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3788bac0-17, col_values=(('qos', UUID('650e13ce-ece5-4f40-b1c7-206442e734f5')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3788bac0-17, col_values=(('external_ids', {'iface-id': '3788bac0-17f5-41ed-889d-2649ea453783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:86:92', 'vm-uuid': '46998ac1-8bf2-4277-a9cd-f8ecf53c5576'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad4c99-ae88-4221-b722-9710a89734a2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:33 user nova-compute[75634]: INFO os_vif [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b7bde-6e54-4aa7-9ba2-73d3cedfdcf4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWNvGSdZ {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWNvGSdZ" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[731fa8eb-6002-45cc-a6ba-05f8a8957b8d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWNvGSdZ'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a46927-0d30-4b2d-ac4c-bb8abe8a0caa]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0c906-eaea-467d-b894-f39240ece72e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd325b-3f4f-40bb-86a7-c759b0c5e1b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]
Nov 15 18:42:33 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3891468f-5117-4a99-9e28-f10a1a01ba22]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c66a48-22aa-4166-ae5b-887647072190]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:33 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f70c092-3341-40b0-9708-3466b83d17a2]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== connect_volume: return (2383ms) {'type': 'block', 'scsi_wwn': '23439636266646664', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439636266646664', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-ServerActionsTestOtherA-server-470214741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:34 user nova-compute[75634]:   <uuid>e8988672-a7d0-4098-8f85-4fc83584da4d</uuid>
Nov 15 18:42:34 user nova-compute[75634]:   <name>instance-0000000f</name>
Nov 15 18:42:34 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:34 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:34 user nova-compute[75634]:   <metadata>
Nov 15 18:42:34 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:34 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherA-server-470214741</nova:name>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:32</nova:creationTime>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:34 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:34 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:user uuid="3ebb5c4075034b1482d50a9ff5dd990b">tempest-ServerActionsTestOtherA-1839012723-project-member</nova:user>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:project uuid="0fb5adcf609a4fd7a67d3574243cc920">tempest-ServerActionsTestOtherA-1839012723</nova:project>
Nov 15 18:42:34 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:34 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:34 user nova-compute[75634]:         <nova:port uuid="0727a542-fa46-4bf2-8a73-49aa02c2547d">
Nov 15 18:42:34 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:42:34 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:34 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:34 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:34 user nova-compute[75634]:   </metadata>
Nov 15 18:42:34 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:34 user nova-compute[75634]:     <system>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="serial">e8988672-a7d0-4098-8f85-4fc83584da4d</entry>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="uuid">e8988672-a7d0-4098-8f85-4fc83584da4d</entry>
Nov 15 18:42:34 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:34 user nova-compute[75634]:     </system>
Nov 15 18:42:34 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:34 user nova-compute[75634]:   <os>
Nov 15 18:42:34 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:34 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:34 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:34 user nova-compute[75634]:   </os>
Nov 15 18:42:34 user nova-compute[75634]:   <features>
Nov 15 18:42:34 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:34 user nova-compute[75634]:     <apic/>
Nov 15 18:42:34 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:34 user nova-compute[75634]:   </features>
Nov 15 18:42:34 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:34 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:34 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:34 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:34 user nova-compute[75634]:   </clock>
Nov 15 18:42:34 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:34 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:34 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:34 user nova-compute[75634]:   </cpu>
Nov 15 18:42:34 user nova-compute[75634]:   <devices>
Nov 15 18:42:34 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:42:34 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:42:34 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk"/>
Nov 15 18:42:34 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:34 user nova-compute[75634]:     </disk>
Nov 15 18:42:34 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:42:34 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:34 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:42:34 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:42:34 user nova-compute[75634]:       <serial>adc5a166-a8c2-4e98-aae8-2a643ca432a2</serial>
Nov 15 18:42:34 user nova-compute[75634]:     </disk>
Nov 15 18:42:34 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:34 user nova-compute[75634]:       <mac address="fa:16:3e:95:33:70"/>
Nov 15 18:42:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:34 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:34 user nova-compute[75634]:       <target dev="tap0727a542-fa"/>
Nov 15 18:42:34 user nova-compute[75634]:     </interface>
Nov 15 18:42:34 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:34 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/console.log" append="off"/>
Nov 15 18:42:34 user nova-compute[75634]:     </serial>
Nov 15 18:42:34 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:34 user nova-compute[75634]:     <video>
Nov 15 18:42:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:34 user nova-compute[75634]:     </video>
Nov 15 18:42:34 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:34 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:34 user nova-compute[75634]:     </rng>
Nov 15 18:42:34 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:34 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:34 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:34 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:34 user nova-compute[75634]:   </devices>
Nov 15 18:42:34 user nova-compute[75634]: </domain>
Nov 15 18:42:34 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-ServerActionsTestOtherA-server-470214741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG os_vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c151304d-0aeb-56d5-8f80-4bba62032f24', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0727a542-fa, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0727a542-fa, col_values=(('qos', UUID('3b1c3179-bf24-40aa-bf80-474cce3fb76b')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0727a542-fa, col_values=(('external_ids', {'iface-id': '0727a542-fa46-4bf2-8a73-49aa02c2547d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:33:70', 'vm-uuid': 'e8988672-a7d0-4098-8f85-4fc83584da4d'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:34 user nova-compute[75634]: INFO os_vif [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa')
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:95:33:70, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:35 user nova-compute[75634]: WARNING nova.compute.manager [req-7d5ca891-f370-4d80-85a9-1f71ff7cd039 req-eab5e1b1-8a5e-4f75-850f-5588474146da service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state resized and task_state resize_reverting.
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoCERHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:36 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a21396-682d-480f-97b6-a6b4a2939646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:36 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0053b46-fe63-40d5-8d6a-a66e2cff0062]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c] added
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc17e86-85a9-4e72-ad61-a694be43fe3c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0c0a64-8b12-4158-8af5-85b0f53d75b8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKoCERHe {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKoCERHe" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f60cbb5-cfc0-4e42-b47b-e36b7f57fab6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKoCERHe'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718b5a1-3f43-48eb-9798-7cc486d80de9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab49ed9-1498-4a8d-8ed3-8f8a123f353d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fc7a74-c5e0-4a1a-ba11-0dbfa9de72af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260]
Nov 15 18:42:36 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd21337a-07de-417a-ae37-a702627eb7bd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888fca3-af94-4a55-9416-6be78c74273e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:36 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc250e-d1ed-47b6-8caf-a2bfedc9311a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoCERHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:37 user nova-compute[75634]: WARNING nova.compute.manager [req-54d5f51f-d5c4-41bf-afcb-e20a11783d88 req-389b02a5-8086-4d1e-965d-59bba08ffaf7 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state active and task_state rebuild_spawning.
Nov 15 18:42:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGtLlcbw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:37 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:37 user nova-compute[75634]: WARNING nova.compute.manager [req-24d39036-e35b-47ac-8208-dbb407bf159c req-a4dd4ba1-4075-497c-ac89-90341544714a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state resized and task_state resize_reverting.
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23335643863663131', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335643863663131', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.367s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:37 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:37 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.objects.instance [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lazy-loading 'flavor' on Instance uuid f1e387c8-c2b7-4b3f-bef5-67a629090c72 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53dc46a-a7ae-4980-a9fe-41724337fd92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:42:37 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:42:37 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:37 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:42:37 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:42:37 user nova-compute[75634]:   <serial>c7e6e2ae-37da-479d-9d5d-8fa70c80028c</serial>
Nov 15 18:42:37 user nova-compute[75634]: </disk>
Nov 15 18:42:37 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be511b00-735f-4867-8a43-fbcb65576833]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0] added
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c2b40-5325-43be-818b-67d31cec5951]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d212f-5fdc-41cc-a045-83e2e13241f6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGtLlcbw {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGtLlcbw" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b60f1-bedf-444f-9a00-32e66773356f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGtLlcbw'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b3ba1-fa30-4b7b-b57d-0570b0f5149a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63dbf8-af5a-485c-ab38-028a4371140d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b743412-744a-4bce-a4b1-252047cb084d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260]
Nov 15 18:42:37 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d14c6-601b-45a3-affa-f84ee0de4352]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a08c23-f636-48a8-9f59-76b4a9d85ad2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:37 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:42:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d9789-a50e-4c91-8a48-8139e374580b]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:42:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGtLlcbw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] No VIF found with MAC fa:16:3e:21:2b:b3, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46d32817-b4d0-460e-9926-b0b977af77e4 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.673s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:38 user nova-compute[75634]: INFO nova.compute.manager [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Terminating instance
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== connect_volume: return (1774ms) {'type': 'block', 'scsi_wwn': '23765323833326337', 'path': '/dev/sdh'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323833326337', 'path': '/dev/sdh'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:42:38 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:42:38 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:42:38 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:42:38 user nova-compute[75634]:   <serial>05d4860c-b031-4cca-8210-4dad1ac07ab0</serial>
Nov 15 18:42:38 user nova-compute[75634]: </disk>
Nov 15 18:42:38 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance running successfully.
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] finish_revert_migration finished successfully. {{(pid=75634) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:39 user nova-compute[75634]: WARNING nova.compute.manager [req-2903c1af-e5bf-4df1-910f-0cb2eac1e45e req-98f66efc-3bb9-494d-9ba2-98eaabfbdc11 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state active and task_state rebuild_spawning.
Nov 15 18:42:39 user nova-compute[75634]: INFO nova.compute.manager [None req-5cd4d077-7c86-41fb-8e3a-fb094e7910bb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance to original state: 'active'
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-unplugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] No waiting events found dispatching network-vif-unplugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f934838-68e1-4ac7-a6cc-87786082362a req-e3662c85-64da-420f-bf2f-9e4e537b7bf6 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-unplugged-193c6ddf-0d51-4779-8ca2-561420f99759 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance spawned successfully.
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Instance destroyed successfully.
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lazy-loading 'resources' on Instance uuid f1e387c8-c2b7-4b3f-bef5-67a629090c72 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1357615068',display_name='tempest-DeleteServersTestJSON-server-1357615068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1357615068',id=16,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='245b9088595044cbb12b368de21b7cb0',ramdisk_id='',reservation_id='r-ns0icx0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-22479761',owner_user_name='tempest-DeleteServersTestJSON-22479761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:40:45Z,user_data=None,user_id='1fa393dacc464e1da2ce989f0a3c7d29',uuid=f1e387c8-c2b7-4b3f-bef5-67a629090c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converting VIF {"id": "193c6ddf-0d51-4779-8ca2-561420f99759", "address": "fa:16:3e:21:2b:b3", "network": {"id": "0fe18dce-daf4-4f48-96ae-007b21e61525", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1851837400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "245b9088595044cbb12b368de21b7cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c6ddf-0d", "ovs_interfaceid": "193c6ddf-0d51-4779-8ca2-561420f99759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG os_vif [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap193c6ddf-0d, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6218a04-27de-497d-b0d6-8d55fcfb58e1) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:39 user nova-compute[75634]: INFO os_vif [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2b:b3,bridge_name='br-int',has_traffic_filtering=True,id=193c6ddf-0d51-4779-8ca2-561420f99759,network=Network(0fe18dce-daf4-4f48-96ae-007b21e61525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c6ddf-0d')
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoCERHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:42:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:42:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:4a:7b:21, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a5a6c-4c2d-4a97-beb2-2ac7d07727de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75634) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:42:40 user nova-compute[75634]: No targets found.
Nov 15 18:42:40 user nova-compute[75634]: iSNS:
Nov 15 18:42:40 user nova-compute[75634]: No targets found.
Nov 15 18:42:40 user nova-compute[75634]: STATIC:
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:42:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:42:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:42:40 user nova-compute[75634]: FIRMWARE:
Nov 15 18:42:40 user nova-compute[75634]: No targets found.
Nov 15 18:42:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:42:40 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:42:40 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a674605-f03f-49ea-94c6-27d3478aed9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8bd28d-68ba-4050-8310-d46cfd3fda17]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c (non-flash)
Nov 15 18:42:40 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:42:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b6848f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-964b7c7c-1173-400e-8399-718d35313953 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.112s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a00daf7b-1bf9-4d31-b727-6001a11292c3 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.888s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9ea98-c2f5-4457-ac19-603b5f2e8408]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f931b94-4b72-4bbf-864b-ed32e42570cd]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d5911-0a04-496e-9fd9-1479ba982879]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2de4b-14b6-468e-93d0-077335cd3f8b]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0736bbe-c612-44f4-9bd7-9a6ddf2478ef]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f429652-1c1b-4121-8f7c-150d5a8c00d4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260]
Nov 15 18:42:40 user nova-compute[75634]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c, portal: 172.16.0.220,3260] successful.
Nov 15 18:42:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e6e2ae-37da-479d-9d5d-8fa70c80028c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba02330-6aef-42aa-ac6a-4216f1b40248]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] <== disconnect_volume: return (482ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:42:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Deleting instance files /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72_del
Nov 15 18:42:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Deletion of /opt/stack/data/nova/instances/f1e387c8-c2b7-4b3f-bef5-67a629090c72_del complete
Nov 15 18:42:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:40 user nova-compute[75634]: INFO nova.compute.manager [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 15 18:42:40 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:40 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:40 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Took 0.50 seconds to deallocate network for instance.
Nov 15 18:42:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-91dc4e41-53f2-4ef0-8e26-4855226002e0 req-b18e3441-59cb-4363-a1b6-6d7160281567 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-deleted-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] Acquiring lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] No waiting events found dispatching network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:41 user nova-compute[75634]: WARNING nova.compute.manager [req-14f8bd6c-4d8e-41e0-bdde-5dbb50a0ae58 req-956de9d3-c3a3-4ef9-b20d-76d2a09b9829 service nova] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Received unexpected event network-vif-plugged-193c6ddf-0d51-4779-8ca2-561420f99759 for instance with vm_state active and task_state deleting.
Nov 15 18:42:42 user nova-compute[75634]: INFO nova.compute.manager [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] [instance: f1e387c8-c2b7-4b3f-bef5-67a629090c72] Took 1.04 seconds to detach 1 volumes for instance.
Nov 15 18:42:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.660s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:42 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Deleted allocations for instance f1e387c8-c2b7-4b3f-bef5-67a629090c72
Nov 15 18:42:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57a7d826-6672-436a-ba1b-718cee31ca30 tempest-DeleteServersTestJSON-22479761 tempest-DeleteServersTestJSON-22479761-project-member] Lock "f1e387c8-c2b7-4b3f-bef5-67a629090c72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.122s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:42:44 user nova-compute[75634]: INFO nova.compute.claims [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Claim successful on node user
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:42:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:44 user nova-compute[75634]: DEBUG nova.policy [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a54ff6670dd74beea8b818f8cbd2e93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b1bd5fcf764dbda726e347edd1e63a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:42:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Creating image(s)
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk 1073741824" returned: 0 in 0.065s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Cannot resize image /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Ensure instance console log exists: /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Successfully created port: a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Successfully updated port: a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquired lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-changed-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Refreshing instance network info cache due to event network-changed-a0e5b165-2d33-428f-9ee5-4b9c27cea694. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] Acquiring lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updating instance_info_cache with network_info: [{"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Releasing lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Instance network_info: |[{"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] Acquired lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:42:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Refreshing network info cache for port a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Start _get_guest_xml network_info=[{"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:42:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-291850120',display_name='tempest-AttachVolumeNegativeTest-server-291850120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-291850120',id=23,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjXyCtgC562+y+oiZEEtBLrm/PzD8T6v4DzwItDjUNf3ogpKkZocYuIEIGb8AJ6kuqor4jCuo4xeDFsJUA3MW2VMXktfVttEFisDwj/5mkju4P3riyYXkxBlFjvke6vag==',key_name='tempest-keypair-621109244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-1ce03c6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=81ef9a69-0f1f-4b72-b74c-98805fe35031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ef9a69-0f1f-4b72-b74c-98805fe35031 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:42:47 user nova-compute[75634]:   <uuid>81ef9a69-0f1f-4b72-b74c-98805fe35031</uuid>
Nov 15 18:42:47 user nova-compute[75634]:   <name>instance-00000017</name>
Nov 15 18:42:47 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:42:47 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:42:47 user nova-compute[75634]:   <metadata>
Nov 15 18:42:47 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:42:47 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeNegativeTest-server-291850120</nova:name>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:42:47</nova:creationTime>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:42:47 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:42:47 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:owner>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:user uuid="a54ff6670dd74beea8b818f8cbd2e93c">tempest-AttachVolumeNegativeTest-1838989545-project-member</nova:user>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:project uuid="a8b1bd5fcf764dbda726e347edd1e63a">tempest-AttachVolumeNegativeTest-1838989545</nova:project>
Nov 15 18:42:47 user nova-compute[75634]:       </nova:owner>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:42:47 user nova-compute[75634]:       <nova:ports>
Nov 15 18:42:47 user nova-compute[75634]:         <nova:port uuid="a0e5b165-2d33-428f-9ee5-4b9c27cea694">
Nov 15 18:42:47 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:42:47 user nova-compute[75634]:         </nova:port>
Nov 15 18:42:47 user nova-compute[75634]:       </nova:ports>
Nov 15 18:42:47 user nova-compute[75634]:     </nova:instance>
Nov 15 18:42:47 user nova-compute[75634]:   </metadata>
Nov 15 18:42:47 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:42:47 user nova-compute[75634]:     <system>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="serial">81ef9a69-0f1f-4b72-b74c-98805fe35031</entry>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="uuid">81ef9a69-0f1f-4b72-b74c-98805fe35031</entry>
Nov 15 18:42:47 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:42:47 user nova-compute[75634]:     </system>
Nov 15 18:42:47 user nova-compute[75634]:   </sysinfo>
Nov 15 18:42:47 user nova-compute[75634]:   <os>
Nov 15 18:42:47 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:42:47 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:42:47 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:42:47 user nova-compute[75634]:   </os>
Nov 15 18:42:47 user nova-compute[75634]:   <features>
Nov 15 18:42:47 user nova-compute[75634]:     <acpi/>
Nov 15 18:42:47 user nova-compute[75634]:     <apic/>
Nov 15 18:42:47 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:42:47 user nova-compute[75634]:   </features>
Nov 15 18:42:47 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:42:47 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:42:47 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:42:47 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:42:47 user nova-compute[75634]:   </clock>
Nov 15 18:42:47 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:42:47 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:42:47 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:42:47 user nova-compute[75634]:   </cpu>
Nov 15 18:42:47 user nova-compute[75634]:   <devices>
Nov 15 18:42:47 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:42:47 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:42:47 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk"/>
Nov 15 18:42:47 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:42:47 user nova-compute[75634]:     </disk>
Nov 15 18:42:47 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:42:47 user nova-compute[75634]:       <mac address="fa:16:3e:63:cd:be"/>
Nov 15 18:42:47 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:47 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:42:47 user nova-compute[75634]:       <target dev="tapa0e5b165-2d"/>
Nov 15 18:42:47 user nova-compute[75634]:     </interface>
Nov 15 18:42:47 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:42:47 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/console.log" append="off"/>
Nov 15 18:42:47 user nova-compute[75634]:     </serial>
Nov 15 18:42:47 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:42:47 user nova-compute[75634]:     <video>
Nov 15 18:42:47 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:42:47 user nova-compute[75634]:     </video>
Nov 15 18:42:47 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:42:47 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:42:47 user nova-compute[75634]:     </rng>
Nov 15 18:42:47 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:42:47 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:42:47 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:42:47 user nova-compute[75634]:     </memballoon>
Nov 15 18:42:47 user nova-compute[75634]:   </devices>
Nov 15 18:42:47 user nova-compute[75634]: </domain>
Nov 15 18:42:47 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-291850120',display_name='tempest-AttachVolumeNegativeTest-server-291850120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-291850120',id=23,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjXyCtgC562+y+oiZEEtBLrm/PzD8T6v4DzwItDjUNf3ogpKkZocYuIEIGb8AJ6kuqor4jCuo4xeDFsJUA3MW2VMXktfVttEFisDwj/5mkju4P3riyYXkxBlFjvke6vag==',key_name='tempest-keypair-621109244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-1ce03c6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=81ef9a69-0f1f-4b72-b74c-98805fe35031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG os_vif [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eba3cab2-d547-5002-8de1-c157934a977b', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e5b165-2d, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0e5b165-2d, col_values=(('qos', UUID('a9b6fe93-0dd7-4d63-bea3-8a3f75ac8211')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0e5b165-2d, col_values=(('external_ids', {'iface-id': 'a0e5b165-2d33-428f-9ee5-4b9c27cea694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:cd:be', 'vm-uuid': '81ef9a69-0f1f-4b72-b74c-98805fe35031'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:47 user nova-compute[75634]: INFO os_vif [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d')
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:63:cd:be, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updated VIF entry in instance network info cache for port a0e5b165-2d33-428f-9ee5-4b9c27cea694. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updating instance_info_cache with network_info: [{"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-24ef62d4-d694-453b-b357-a9656d3e64f3 req-f113d9fe-6a22-47de-bda9-bb9032d97591 service nova] Releasing lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:42:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] No waiting events found dispatching network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:49 user nova-compute[75634]: WARNING nova.compute.manager [req-c0732d16-84a2-4b53-8d72-9a37eb0ea34e req-9ab44887-9c96-4b16-889d-b7b5c798b013 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received unexpected event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 for instance with vm_state building and task_state spawning.
Nov 15 18:42:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:42:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Instance spawned successfully.
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] No waiting events found dispatching network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:51 user nova-compute[75634]: WARNING nova.compute.manager [req-7bf955f3-b59f-4a11-a2d6-bde3c5ef9600 req-92d44655-12d7-4180-9a26-a15e2af59449 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received unexpected event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 for instance with vm_state building and task_state spawning.
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:42:51 user nova-compute[75634]: INFO nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 15 18:42:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:42:51 user nova-compute[75634]: INFO nova.compute.manager [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Took 7.28 seconds to build instance.
Nov 15 18:42:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-221bb967-753f-4c47-985d-1576463375f1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.383s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:57 user nova-compute[75634]: INFO nova.compute.manager [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Terminating instance
Nov 15 18:42:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-adda19e4-6f3a-45ed-9386-57f587e760b0 req-6b5f4985-a325-49fb-836b-e0d097a0e136 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-unplugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:42:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Instance destroyed successfully.
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.objects.instance [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'resources' on Instance uuid d14a0c65-0ba1-4919-80b8-5295e100a7f7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-12552747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-12552747',id=2,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB7iOyoiiOgyqpFSqgBP8vgPi0Pl4dT/C57yqn88S6pO7+tpJCZE1OZQ6q9PuMUlXlNZXb3PuJcLqM6M+WYtpymDEhY7IQ42Cf9jJTK4q7hhK+ku29pS2DUnARQGkf6pA==',key_name='tempest-keypair-1072552389',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-ue3u9rdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=d14a0c65-0ba1-4919-80b8-5295e100a7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "5abcd712-2686-44c8-9798-983e094f7649", "address": "fa:16:3e:fa:c4:06", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abcd712-26", "ovs_interfaceid": "5abcd712-2686-44c8-9798-983e094f7649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG os_vif [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5abcd712-26, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e711955-c125-4a59-b4eb-8b6bc50903d2) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:42:58 user nova-compute[75634]: INFO os_vif [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c4:06,bridge_name='br-int',has_traffic_filtering=True,id=5abcd712-2686-44c8-9798-983e094f7649,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abcd712-26')
Nov 15 18:42:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Deleting instance files /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7_del
Nov 15 18:42:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Deletion of /opt/stack/data/nova/instances/d14a0c65-0ba1-4919-80b8-5295e100a7f7_del complete
Nov 15 18:42:58 user nova-compute[75634]: INFO nova.compute.manager [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 18:42:58 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:42:58 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:42:59 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Took 0.74 seconds to deallocate network for instance.
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:59 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Deleted allocations for instance d14a0c65-0ba1-4919-80b8-5295e100a7f7
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cfca3d64-1c5d-47dc-82dc-effcb2c97549 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] Acquiring lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] Lock "d14a0c65-0ba1-4919-80b8-5295e100a7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] No waiting events found dispatching network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:42:59 user nova-compute[75634]: WARNING nova.compute.manager [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received unexpected event network-vif-plugged-5abcd712-2686-44c8-9798-983e094f7649 for instance with vm_state deleted and task_state None.
Nov 15 18:42:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-34df2b2e-0245-47e0-8df5-dc65889e5f56 req-46cd5cd8-a154-4371-a322-4385217d34d0 service nova] [instance: d14a0c65-0ba1-4919-80b8-5295e100a7f7] Received event network-vif-deleted-5abcd712-2686-44c8-9798-983e094f7649 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid b44cd307-ffbe-4ccd-996f-299ce61b60a6 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 81ef9a69-0f1f-4b72-b74c-98805fe35031 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:19 user nova-compute[75634]: WARNING oslo_messaging._drivers.amqpdriver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:43:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=6906MB free_disk=25.312232971191406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance aa6bb849-3c0b-4ee5-9851-853c7cad944d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 54932a79-b9a3-4735-a317-a4b2b5a38443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 81ef9a69-0f1f-4b72-b74c-98805fe35031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:43:24 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:43:25 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:43:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:43:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:43:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updating instance_info_cache with network_info: [{"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:43:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:43:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:43:38 user nova-compute[75634]: INFO nova.compute.manager [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] instance snapshotting
Nov 15 18:43:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Beginning live snapshot process
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7.delta 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7.delta 1073741824" returned: 0 in 0.047s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 18:43:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] COPY block job progress, current cursor: 74579968 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-changed-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing instance network info cache due to event network-changed-d6c2806f-364a-4af9-a63a-f05271d7bf06. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] Acquiring lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] Acquired lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.network.neutron [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Refreshing network info cache for port d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:43:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 18:43:41 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:43:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7.delta /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updated VIF entry in instance network info cache for port d6c2806f-364a-4af9-a63a-f05271d7bf06. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:43:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94cd26b2-2735-4bf0-a39d-c57121a1b626 req-641bcb5b-5b69-48c6-b355-f62fa0751833 service nova] Releasing lock "refresh_cache-4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:43:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7.delta /opt/stack/data/nova/instances/snapshots/tmp39nhbif7/23a7748eb1e4480fbf1b7f4d73cf67f7" returned: 0 in 0.580s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:42 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Snapshot extracted, beginning image upload
Nov 15 18:43:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:44 user nova-compute[75634]: INFO nova.compute.manager [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Terminating instance
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-b2a20dd3-0086-4cc9-b1df-695fb949f996 req-3661d7f5-4dd4-4d84-b593-20f1d3ea0303 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-94c3d5b8-621a-419a-8215-b6d39778b711 req-8a971d2f-fe77-4e9c-b586-5100316592e4 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-9c335e11-f89c-4856-9374-7498e2c1a93d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Snapshot image upload complete
Nov 15 18:43:45 user nova-compute[75634]: INFO nova.compute.manager [None req-697ee3ce-3a0b-42c4-8a96-cbc55b73b24a tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Took 6.14 seconds to snapshot the instance on the hypervisor.
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-62e2c677-2daa-4e0f-a6bf-4f16270fe258 req-725f986e-5720-4ff2-94b6-6e9090e714e1 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Instance destroyed successfully.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lazy-loading 'resources' on Instance uuid 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c2806f-36, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9c32168-df7a-4f15-a9c6-eb70cf0148d9) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:3f:a9,bridge_name='br-int',has_traffic_filtering=True,id=d6c2806f-364a-4af9-a63a-f05271d7bf06,network=Network(d7e6dc05-36dc-486d-a75f-8b3294a6101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c2806f-36')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c335e11-f8, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a664454-c4c3-4489-ad49-34d8a4e42567) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c335e11-f89c-4856-9374-7498e2c1a93d,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c335e11-f8')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc259b69f-6a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4acab4a-e456-4753-84e7-3f0c82419cd3) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:5b:e8,bridge_name='br-int',has_traffic_filtering=True,id=c259b69f-6a94-4872-a9e7-ddd5a7934263,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc259b69f-6a')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b292661-41, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2fb9a1-1d7f-46aa-a419-8306bdedd3eb) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:09:4d,bridge_name='br-int',has_traffic_filtering=True,id=0b292661-4105-4170-8c61-337f9138a0b6,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b292661-41')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057a5bf9-46, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca8a7e21-1035-4196-bb97-14f3b71ad235) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:71:ea,bridge_name='br-int',has_traffic_filtering=True,id=057a5bf9-46aa-4a7f-9b62-dd416a745484,network=Network(c4c60182-7c08-499e-9fd3-d9b83ccc0f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057a5bf9-46')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "address": "fa:16:3e:f5:c3:b9", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72f5027-30", "ovs_interfaceid": "d72f5027-30d7-44f7-8d0e-36ceeb9526d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd72f5027-30, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbd97c28-3152-49bc-8c33-72e026335de6) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:b9,bridge_name='br-int',has_traffic_filtering=True,id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72f5027-30')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1751197559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1751197559',id=19,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWCWXPwTB3btA/MQTkNQDI1Eo9w7zBHoEQUYIXbJvkNWlc2HGHV+lPYRZuJQkZYkzwBVeAyjgAYfyIxLj4YtT1FbhHU4PVNLj+lXjoCWt/Pd7T72jG6d1I7ABBC4zwcHg==',key_name='tempest-keypair-973725052',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f4d1fa34694b47bf6c8f216cc6c7fc',ramdisk_id='',reservation_id='r-hfkpsdap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1080184460',owner_user_name='tempest-TaggedBootDevicesTest-1080184460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a080c7dadb14ea39593f92fa0f8044a',uuid=4548ea11-be1d-4c8c-b3a3-31b5ad0c6765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converting VIF {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa218593a-e2, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=263bef41-8c9f-4808-8a4d-1ccf478b4520) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:46 user nova-compute[75634]: INFO os_vif [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5e:93,bridge_name='br-int',has_traffic_filtering=True,id=a218593a-e2e1-4c5f-abef-f5a59ea29f8a,network=Network(693a4dde-470f-4ea7-b490-8ec5abbe7dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa218593a-e2')
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAnBPxug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d6c2806f-364a-4af9-a63a-f05271d7bf06 for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-c259b69f-6a94-4872-a9e7-ddd5a7934263 for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-0b292661-4105-4170-8c61-337f9138a0b6 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-0b292661-4105-4170-8c61-337f9138a0b6 for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-057a5bf9-46aa-4a7f-9b62-dd416a745484 for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-unplugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-unplugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-4b63122c-6a23-4ac9-af62-32348ba1e1ea req-974054f8-1845-46fa-985b-39d9af543fe2 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd931bf-3fa1-4f09-b3ee-11f4f9e40ef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:43:46 user nova-compute[75634]: No targets found.
Nov 15 18:43:46 user nova-compute[75634]: iSNS:
Nov 15 18:43:46 user nova-compute[75634]: No targets found.
Nov 15 18:43:46 user nova-compute[75634]: STATIC:
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:43:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:46 user nova-compute[75634]: FIRMWARE:
Nov 15 18:43:46 user nova-compute[75634]: No targets found.
Nov 15 18:43:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:43:46 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:43:46 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab17381-9b4f-4a4b-9cc8-68c9861b4bcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade707c-21e4-4381-ac27-7a6be360c94b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68295cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf9e60-e90e-4344-a2e2-9ba8b1b98bcc]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[843bd6c1-d5d2-48fc-823f-c3d2422afbdc]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:46 user nova-compute[75634]: WARNING nova.compute.manager [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-9c335e11-f89c-4856-9374-7498e2c1a93d for instance with vm_state active and task_state deleting.
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-changed-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Refreshing instance network info cache due to event network-changed-40106406-5d49-4704-8ec4-ee3f09af1869. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Acquiring lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Acquired lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Refreshing network info cache for port 40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa67b6-db08-4173-a14f-126a48d41439]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d16d13a-31c5-46f3-a2a0-0772e0394f08]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[adabd377-1198-4bbc-b517-e5646f7af58d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd7844-6b53-4523-9e59-795d4d1810d3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260]
Nov 15 18:43:46 user nova-compute[75634]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be, portal: 172.16.0.220,3260] successful.
Nov 15 18:43:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7b487c-336e-4afd-a5d5-d07dda4250be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc165b-a61c-4b0f-985a-1c6ff2398b75]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== disconnect_volume: return (356ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQGcCnov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:43:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[805eba2b-8e70-4a17-846e-a26102cd54ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]: iSNS:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]: STATIC:
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: FIRMWARE:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:43:47 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:43:47 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[77caeec0-06ce-42bf-ac38-87d15f097a52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b75e6-e633-484a-9c2e-6687dacb0911]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4431dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53437caa-9e78-46ae-9cc1-0bf48a464d17]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f2dc71-69fb-4ec1-9d87-7ec3240ce360]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a6e59b-5749-4700-b095-009325d82192]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Ignoring supplied device name: /dev/vdb
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a3e65d-312c-404b-937b-c400c9d1a70b]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.084s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf0841f-4603-445a-bfef-cee7fbe623d8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updated VIF entry in instance network info cache for port 40106406-5d49-4704-8ec4-ee3f09af1869. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating instance_info_cache with network_info: [{"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f69879f9-28b1-4ada-8b55-30ad94e5cf81 req-4893cd4f-f6fb-4dc1-8538-a0d4ab76f365 service nova] Releasing lock "refresh_cache-54932a79-b9a3-4735-a317-a4b2b5a38443" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[49395217-d090-4d5b-ae65-885cc29dc571]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260]
Nov 15 18:43:47 user nova-compute[75634]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977, portal: 172.16.0.220,3260] successful.
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:47 user nova-compute[75634]: INFO nova.compute.manager [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Attaching volume 64a924cb-4628-4c5e-b018-c95126d6aa48 to /dev/vdb
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bd95688-205a-4af6-83a2-9ec8ac5db977 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a88e2a2-7a8b-4f12-bfba-fdf25c4cc067]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== disconnect_volume: return (439ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWIhOGtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:43:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] Acquiring lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] No waiting events found dispatching network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:47 user nova-compute[75634]: WARNING nova.compute.manager [req-8380620f-0b4f-451d-b802-46734f21e0d4 req-f43f6d81-ee38-4402-93a4-529b9cbbb292 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received unexpected event network-vif-plugged-a218593a-e2e1-4c5f-abef-f5a59ea29f8a for instance with vm_state active and task_state deleting.
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[85792abc-92cd-4a6d-820b-ed002025c8c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]: iSNS:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]: STATIC:
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:43:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:43:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:43:47 user nova-compute[75634]: FIRMWARE:
Nov 15 18:43:47 user nova-compute[75634]: No targets found.
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:43:47 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:43:47 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba1dcd5-814b-4c28-8bf5-290dc6dfdd53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a93e90-0090-4c93-bcc0-f4f22a2026d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb74c2-d1bd-4e3d-bf9d-e2ae5c5203ce]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b681069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a75b66-f327-4b1c-8e83-d06a68ff875b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e0e7f-ff96-482b-a8d6-fcb1b26ebabd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[51476022-f991-4fd9-b1a9-03001d8cdf13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f2cbc-0de7-4160-bd93-a47063855952]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:43:47 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6251a0-b9c9-4d63-9a17-067f62cf88b3]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating existing volume attachment record: 344e77cf-3ff2-4a7f-8aba-30793bc56c33 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5046c-6e63-427d-9213-4feb2defe9ab]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[038749a8-5388-4448-b3df-2ced044f26c5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8bf3f-64da-43b6-9d75-d3b87e1d6b94]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed737232-e068-4059-a79a-139a8ba9ad2c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1231a43-f8ca-4452-a143-9d03df7d7bc2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260]
Nov 15 18:43:47 user nova-compute[75634]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d, portal: 172.16.0.220,3260] successful.
Nov 15 18:43:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b748e78-8493-4094-9998-8a01593cba8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7fff0c-1931-4128-a6b4-2dabb7ec07d5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] <== disconnect_volume: return (399ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:43:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Deleting instance files /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765_del
Nov 15 18:43:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Deletion of /opt/stack/data/nova/instances/4548ea11-be1d-4c8c-b3a3-31b5ad0c6765_del complete
Nov 15 18:43:47 user nova-compute[75634]: INFO nova.compute.manager [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Took 3.73 seconds to destroy the instance on the hypervisor.
Nov 15 18:43:47 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:43:47 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:43:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c1a7daa-e5c6-4611-aeac-c2a0fa8e645b req-ce0f59ac-6799-45ce-83d8-614b77c06888 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-deleted-d72f5027-30d7-44f7-8d0e-36ceeb9526d3 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:50 user nova-compute[75634]: INFO nova.compute.manager [req-1c1a7daa-e5c6-4611-aeac-c2a0fa8e645b req-ce0f59ac-6799-45ce-83d8-614b77c06888 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Neutron deleted interface d72f5027-30d7-44f7-8d0e-36ceeb9526d3; detaching it from the instance and deleting it from the info cache
Nov 15 18:43:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-1c1a7daa-e5c6-4611-aeac-c2a0fa8e645b req-ce0f59ac-6799-45ce-83d8-614b77c06888 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [{"id": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "address": "fa:16:3e:f6:3f:a9", "network": {"id": "d7e6dc05-36dc-486d-a75f-8b3294a6101d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-572992748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c2806f-36", "ovs_interfaceid": "d6c2806f-364a-4af9-a63a-f05271d7bf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c335e11-f89c-4856-9374-7498e2c1a93d", "address": "fa:16:3e:af:86:fb", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c335e11-f8", "ovs_interfaceid": "9c335e11-f89c-4856-9374-7498e2c1a93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "address": "fa:16:3e:dc:5b:e8", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc259b69f-6a", "ovs_interfaceid": "c259b69f-6a94-4872-a9e7-ddd5a7934263", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b292661-4105-4170-8c61-337f9138a0b6", "address": "fa:16:3e:3d:09:4d", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b292661-41", "ovs_interfaceid": "0b292661-4105-4170-8c61-337f9138a0b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "address": "fa:16:3e:13:71:ea", "network": {"id": "c4c60182-7c08-499e-9fd3-d9b83ccc0f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1736571493", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057a5bf9-46", "ovs_interfaceid": "057a5bf9-46aa-4a7f-9b62-dd416a745484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "address": "fa:16:3e:28:5e:93", "network": {"id": "693a4dde-470f-4ea7-b490-8ec5abbe7dac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942446760", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50f4d1fa34694b47bf6c8f216cc6c7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa218593a-e2", "ovs_interfaceid": "a218593a-e2e1-4c5f-abef-f5a59ea29f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c1a7daa-e5c6-4611-aeac-c2a0fa8e645b req-ce0f59ac-6799-45ce-83d8-614b77c06888 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Detach interface failed, port_id=d72f5027-30d7-44f7-8d0e-36ceeb9526d3, reason: Instance 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:43:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:52 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Took 4.12 seconds to deallocate network for instance.
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-4aa48b89-e25e-4f47-b3ec-4b802537e008 req-addf1557-bc21-4122-afda-859dddb0dd20 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-deleted-0b292661-4105-4170-8c61-337f9138a0b6 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-4aa48b89-e25e-4f47-b3ec-4b802537e008 req-addf1557-bc21-4122-afda-859dddb0dd20 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-deleted-d6c2806f-364a-4af9-a63a-f05271d7bf06 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-4aa48b89-e25e-4f47-b3ec-4b802537e008 req-addf1557-bc21-4122-afda-859dddb0dd20 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-deleted-057a5bf9-46aa-4a7f-9b62-dd416a745484 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-4aa48b89-e25e-4f47-b3ec-4b802537e008 req-addf1557-bc21-4122-afda-859dddb0dd20 service nova] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Received event network-vif-deleted-a218593a-e2e1-4c5f-abef-f5a59ea29f8a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:43:52 user nova-compute[75634]: INFO nova.compute.claims [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Claim successful on node user
Nov 15 18:43:52 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iayoGQcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:43:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:43:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:43:53 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eaa0ce-8518-4e3d-b5f1-9282cac5b3bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:43:53 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[842341ab-58b9-44c5-9f60-265f690f4567]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48] added
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b70ff22-3f13-41d1-b8f7-5a205d4f87cc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf8d34e-6d01-4257-b8b1-5212eafcf348]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iayoGQcf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iayoGQcf" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d846c0d-d9db-4841-8c26-30b09c7f40a8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iayoGQcf'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.policy [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6642c8d206564bc5b510ce6ead09fc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d2c43038b241429feffe23bbbf4f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c4a86f-fb4d-42fd-af8c-e3881b405cbb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1670bd-68e7-4072-9108-cc66f3f8c88f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:43:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Creating image(s)
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb815e82-cd15-42a9-bad3-795b5bcb32ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260]
Nov 15 18:43:53 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260] successful.
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d7237-7385-4e44-ba51-3794f1bd340e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45702ca-9feb-4b49-a1f8-c1955fb9dbb9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:43:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[350b7a65-0c46-40a3-82fa-c592d1565b9a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk 1073741824" returned: 0 in 0.051s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Successfully created port: bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:43:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Cannot resize image /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Ensure instance console log exists: /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iayoGQcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23362313065393932', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362313065393932', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:43:54 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:43:54 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:43:54 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:43:54 user nova-compute[75634]:   <serial>64a924cb-4628-4c5e-b018-c95126d6aa48</serial>
Nov 15 18:43:54 user nova-compute[75634]: </disk>
Nov 15 18:43:54 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Successfully updated port: bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:43:54 user nova-compute[75634]: INFO nova.compute.manager [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] [instance: 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765] Took 2.59 seconds to detach 3 volumes for instance.
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing instance network info cache due to event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:43:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No VIF found with MAC fa:16:3e:11:7d:7a, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance network_info: |[{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.neutron [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start _get_guest_xml network_info=[{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:43:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:43:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e68dacd-5909-4f7a-a9a8-c9ee0ade9f57 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.656s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDceSRZZYYGJAolOqq+Csa4e5/GlQE0ZUR3RKnZpRDfgvkR68Q6PJk82SbxBJYVuhYJRoZ4hP7JdRVYP9HSe31IA6Hk461NvXTGdxoEdeZxPmRd7RFCbzIMtSKNpJrt+sA==',key_name='tempest-keypair-1393165220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_devices' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:43:55 user nova-compute[75634]:   <uuid>c9581bab-c679-4d43-8e8b-8cc445c22060</uuid>
Nov 15 18:43:55 user nova-compute[75634]:   <name>instance-00000018</name>
Nov 15 18:43:55 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:43:55 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:43:55 user nova-compute[75634]:   <metadata>
Nov 15 18:43:55 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:43:55 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1273182834</nova:name>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:43:55</nova:creationTime>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:43:55 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:43:55 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:owner>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:user uuid="6642c8d206564bc5b510ce6ead09fc2c">tempest-AttachVolumeShelveTestJSON-1234122392-project-member</nova:user>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:project uuid="38d2c43038b241429feffe23bbbf4f1d">tempest-AttachVolumeShelveTestJSON-1234122392</nova:project>
Nov 15 18:43:55 user nova-compute[75634]:       </nova:owner>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:43:55 user nova-compute[75634]:       <nova:ports>
Nov 15 18:43:55 user nova-compute[75634]:         <nova:port uuid="bef57442-7b6f-4366-9270-099f4bd4698d">
Nov 15 18:43:55 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:43:55 user nova-compute[75634]:         </nova:port>
Nov 15 18:43:55 user nova-compute[75634]:       </nova:ports>
Nov 15 18:43:55 user nova-compute[75634]:     </nova:instance>
Nov 15 18:43:55 user nova-compute[75634]:   </metadata>
Nov 15 18:43:55 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:43:55 user nova-compute[75634]:     <system>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="serial">c9581bab-c679-4d43-8e8b-8cc445c22060</entry>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="uuid">c9581bab-c679-4d43-8e8b-8cc445c22060</entry>
Nov 15 18:43:55 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:43:55 user nova-compute[75634]:     </system>
Nov 15 18:43:55 user nova-compute[75634]:   </sysinfo>
Nov 15 18:43:55 user nova-compute[75634]:   <os>
Nov 15 18:43:55 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:43:55 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:43:55 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:43:55 user nova-compute[75634]:   </os>
Nov 15 18:43:55 user nova-compute[75634]:   <features>
Nov 15 18:43:55 user nova-compute[75634]:     <acpi/>
Nov 15 18:43:55 user nova-compute[75634]:     <apic/>
Nov 15 18:43:55 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:43:55 user nova-compute[75634]:   </features>
Nov 15 18:43:55 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:43:55 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:43:55 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:43:55 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:43:55 user nova-compute[75634]:   </clock>
Nov 15 18:43:55 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:43:55 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:43:55 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:43:55 user nova-compute[75634]:   </cpu>
Nov 15 18:43:55 user nova-compute[75634]:   <devices>
Nov 15 18:43:55 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:43:55 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:43:55 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk"/>
Nov 15 18:43:55 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:43:55 user nova-compute[75634]:     </disk>
Nov 15 18:43:55 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:43:55 user nova-compute[75634]:       <mac address="fa:16:3e:d2:ec:18"/>
Nov 15 18:43:55 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:43:55 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:43:55 user nova-compute[75634]:       <target dev="tapbef57442-7b"/>
Nov 15 18:43:55 user nova-compute[75634]:     </interface>
Nov 15 18:43:55 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:43:55 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/console.log" append="off"/>
Nov 15 18:43:55 user nova-compute[75634]:     </serial>
Nov 15 18:43:55 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:43:55 user nova-compute[75634]:     <video>
Nov 15 18:43:55 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:43:55 user nova-compute[75634]:     </video>
Nov 15 18:43:55 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:43:55 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:43:55 user nova-compute[75634]:     </rng>
Nov 15 18:43:55 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:43:55 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:43:55 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:43:55 user nova-compute[75634]:     </memballoon>
Nov 15 18:43:55 user nova-compute[75634]:   </devices>
Nov 15 18:43:55 user nova-compute[75634]: </domain>
Nov 15 18:43:55 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDceSRZZYYGJAolOqq+Csa4e5/GlQE0ZUR3RKnZpRDfgvkR68Q6PJk82SbxBJYVuhYJRoZ4hP7JdRVYP9HSe31IA6Hk461NvXTGdxoEdeZxPmRd7RFCbzIMtSKNpJrt+sA==',key_name='tempest-keypair-1393165220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG os_vif [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19699328-e583-5991-95a3-10bfa3fcf2f5', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef57442-7b, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbef57442-7b, col_values=(('qos', UUID('b67cf492-8dc1-4f0f-a160-223e632a071a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbef57442-7b, col_values=(('external_ids', {'iface-id': 'bef57442-7b6f-4366-9270-099f4bd4698d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ec:18', 'vm-uuid': 'c9581bab-c679-4d43-8e8b-8cc445c22060'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:43:55 user nova-compute[75634]: INFO os_vif [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b')
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:55 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Deleted allocations for instance 4548ea11-be1d-4c8c-b3a3-31b5ad0c6765
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No VIF found with MAC fa:16:3e:d2:ec:18, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fa0a628-4f19-459e-97e1-ebeeb7e0fb7a tempest-TaggedBootDevicesTest-1080184460 tempest-TaggedBootDevicesTest-1080184460-project-member] Lock "4548ea11-be1d-4c8c-b3a3-31b5ad0c6765" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.256s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.neutron [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updated VIF entry in instance network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG nova.network.neutron [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f2a1f921-5104-4938-ab8c-f9244f768f4f req-1ab0e4cc-a1a3-4640-9453-9edc33d1bfe5 service nova] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:43:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:56 user nova-compute[75634]: WARNING nova.compute.manager [req-ab4295dc-5080-4f3b-9431-364f12a6699d req-7bb4ab09-a674-4739-beab-65ae19239b05 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state building and task_state spawning.
Nov 15 18:43:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:43:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance spawned successfully.
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:43:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:43:58 user nova-compute[75634]: WARNING nova.compute.manager [req-facdd4d8-99d9-489d-9df0-ac824e134928 req-54b18613-b5fb-41ac-912b-0185c418e5ff service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state building and task_state spawning.
Nov 15 18:43:59 user nova-compute[75634]: INFO nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 15 18:43:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:43:59 user nova-compute[75634]: INFO nova.compute.manager [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Took 6.76 seconds to build instance.
Nov 15 18:43:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1fe11038-7cf1-4e2b-b52e-0a6a9e04e550 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.872s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing instance network info cache due to event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:44:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] Acquiring lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] Acquired lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG nova.network.neutron [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updated VIF entry in instance network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG nova.network.neutron [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-84e1d49b-ab58-4e77-977a-9931f0867dba req-23f8812d-5c0d-49f6-8ac6-6f484f4b778e service nova] Releasing lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:04 user nova-compute[75634]: INFO nova.compute.manager [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Attaching volume db1f9869-a5cd-4cc9-bccf-9874f7c531c1 to /dev/vdb
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.utils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb421b4d-244c-4ee3-bc3f-667b02fd79a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee3ca2-9b85-4b34-9b9f-70c4878cf16c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f33959-adc3-4d4e-8a97-198994dea2ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7837d7-1e04-4843-ae65-4660d69059bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:04 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:44:04 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357f939-6ac8-45d9-b2b3-08f954d3ad85]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG os_brick.utils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:04 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating existing volume attachment record: bb1539a4-9159-412c-8236-7aca29e3346e {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:44:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:10 user nova-compute[75634]: INFO nova.compute.manager [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Detaching volume 64a924cb-4628-4c5e-b018-c95126d6aa48
Nov 15 18:44:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:10 user nova-compute[75634]: INFO nova.virt.block_device [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Attempting to driver detach volume 64a924cb-4628-4c5e-b018-c95126d6aa48 from mountpoint /dev/vdb
Nov 15 18:44:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Attempting to detach device vdb from instance 54932a79-b9a3-4735-a317-a4b2b5a38443 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:10 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:10 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:44:10 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:10 user nova-compute[75634]:   <serial>64a924cb-4628-4c5e-b018-c95126d6aa48</serial>
Nov 15 18:44:10 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:10 user nova-compute[75634]: </disk>
Nov 15 18:44:10 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully detached device vdb from instance 54932a79-b9a3-4735-a317-a4b2b5a38443 from the persistent domain config.
Nov 15 18:44:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54932a79-b9a3-4735-a317-a4b2b5a38443 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:44:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:10 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:10 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 18:44:10 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:10 user nova-compute[75634]:   <serial>64a924cb-4628-4c5e-b018-c95126d6aa48</serial>
Nov 15 18:44:10 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:10 user nova-compute[75634]: </disk>
Nov 15 18:44:10 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-changed-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Refreshing instance network info cache due to event network-changed-b7a2603a-84df-4520-b566-40a45cee4337. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] Acquiring lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] Acquired lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Refreshing network info cache for port b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updated VIF entry in instance network info cache for port b7a2603a-84df-4520-b566-40a45cee4337. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:44:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-02f8dfc6-873d-45e8-9fb0-e08964d55c0a req-c0117ae0-85df-4cdf-af86-4f934ef246b8 service nova] Releasing lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:14 user nova-compute[75634]: INFO nova.compute.manager [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attaching volume 5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b to /dev/vdb
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.utils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa947612-79c2-46ab-a198-9eddd9b83b09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[49834de7-ab6c-4df6-aa13-94f91613c364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0bf26-14b8-4b9d-ba20-76ea1d62bc19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e9a4d-95ce-47b6-96f2-41156d2b9be3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:14 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:44:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cc4ef3-924f-42d1-bed0-859516c48b13]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG os_brick.utils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:14 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating existing volume attachment record: 488202ef-ef19-44c0-a017-b0dceeebf78b {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbBWeIrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:15 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:15 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:15 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:44:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cdb5d2-9282-4060-93c4-7229be1dda01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:44:15 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc4eb10-76ab-4ea3-94e9-a1e761878a38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1] added
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd499fc-12f9-44a6-982d-953bb983b1ac]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de055e5-b5af-4100-bcdd-4447ae9462a1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbBWeIrj {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbBWeIrj" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53004c51-152f-4a15-aae2-48e4d748373a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZbBWeIrj'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[40713b2f-a4ae-43f0-8fa7-7889b6cade25]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcaee57-db1b-49de-a491-3703893ba143]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5f9d8b-24dc-4819-b86e-850254f9d579]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260]
Nov 15 18:44:16 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[681b5467-cb3a-4bc7-99e9-ec9b1105af44]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12bb828-9d67-4908-b3ee-0690a96ba125]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d3b3f-92f9-4a07-8bfc-2e0448f2ee22]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:44:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbBWeIrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23464333863613039', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333863613039', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:44:17 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:17 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:44:17 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:17 user nova-compute[75634]:   <serial>db1f9869-a5cd-4cc9-bccf-9874f7c531c1</serial>
Nov 15 18:44:17 user nova-compute[75634]: </disk>
Nov 15 18:44:17 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No VIF found with MAC fa:16:3e:93:dc:1d, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:44:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8dfe070c-19ee-41de-b4dc-903340d91e5f tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.470s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evPAxJow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:19 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:19 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:19 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef713cf-568e-4bba-b903-757c1bf0549e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:44:19 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b318dc-f8bb-4121-a22d-fe6ac20e5400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b] added
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a0c718-277c-4114-8204-484fd5cf0486]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb078f-93c4-4012-a1a3-f470f06f3551]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evPAxJow {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evPAxJow" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecb3132-6bcc-4e3f-83a2-9635483b7631]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'evPAxJow'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b1482-76ee-47e8-acd2-3275a75f78d1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477bb6c-ef28-4b36-97a7-cdf11dfd0bc0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d75fa-1d2c-4e0b-a543-e1a1c5905daf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260]
Nov 15 18:44:19 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64187d-9677-41c9-9c7d-6d5c9a30580c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd931961-7cb9-40b9-88d2-b2f9f9b9e292]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:19 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:19 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e0125-8f36-4ec2-9dec-c33a6c7bb110]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:44:19 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evPAxJow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:20 user nova-compute[75634]: INFO nova.compute.manager [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Detaching volume db1f9869-a5cd-4cc9-bccf-9874f7c531c1
Nov 15 18:44:20 user nova-compute[75634]: INFO nova.virt.block_device [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Attempting to driver detach volume db1f9869-a5cd-4cc9-bccf-9874f7c531c1 from mountpoint /dev/vdb
Nov 15 18:44:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Attempting to detach device vdb from instance e76c80e0-0538-428d-bd3c-07985d8205cc from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:20 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:20 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:44:20 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:20 user nova-compute[75634]:   <serial>db1f9869-a5cd-4cc9-bccf-9874f7c531c1</serial>
Nov 15 18:44:20 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:20 user nova-compute[75634]: </disk>
Nov 15 18:44:20 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:20 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully detached device vdb from instance e76c80e0-0538-428d-bd3c-07985d8205cc from the persistent domain config.
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e76c80e0-0538-428d-bd3c-07985d8205cc from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:20 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:20 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:44:20 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:20 user nova-compute[75634]:   <serial>db1f9869-a5cd-4cc9-bccf-9874f7c531c1</serial>
Nov 15 18:44:20 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:20 user nova-compute[75634]: </disk>
Nov 15 18:44:20 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23966353330383139', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966353330383139', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.objects.instance [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:44:20 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:20 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:44:20 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:20 user nova-compute[75634]:   <serial>5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b</serial>
Nov 15 18:44:20 user nova-compute[75634]: </disk>
Nov 15 18:44:20 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:44:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:44:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:44:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No VIF found with MAC fa:16:3e:5c:a4:b0, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:44:21 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-85416e64-f15c-44ba-9b22-e0c395358d36 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.118s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:44:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:44:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7070MB free_disk=25.212772369384766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance aa6bb849-3c0b-4ee5-9851-853c7cad944d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 54932a79-b9a3-4735-a317-a4b2b5a38443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 81ef9a69-0f1f-4b72-b74c-98805fe35031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c9581bab-c679-4d43-8e8b-8cc445c22060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:44:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:28 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:28 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [{"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-46998ac1-8bf2-4277-a9cd-f8ecf53c5576" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:44:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:44:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 54932a79-b9a3-4735-a317-a4b2b5a38443 is timed out.
Nov 15 18:44:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully detached device vdb from instance 54932a79-b9a3-4735-a317-a4b2b5a38443 from the live domain config.
Nov 15 18:44:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iayoGQcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec071b88-11e2-4dc2-9c81-cc9c40098938]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:44:31 user nova-compute[75634]: No targets found.
Nov 15 18:44:31 user nova-compute[75634]: iSNS:
Nov 15 18:44:31 user nova-compute[75634]: No targets found.
Nov 15 18:44:31 user nova-compute[75634]: STATIC:
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48
Nov 15 18:44:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:31 user nova-compute[75634]: FIRMWARE:
Nov 15 18:44:31 user nova-compute[75634]: No targets found.
Nov 15 18:44:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:44:31 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:44:31 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2e4ca-2bc2-487d-be40-8df334fe0eb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ee7bb-d947-4299-8255-8c2b61778ae6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:31 user nova-compute[75634]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)
Nov 15 18:44:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68446b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa316b7f-f52d-4f9f-bda5-936a0900c67e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13e67ba-99d3-40be-aafe-f4459fa3550d]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bfb76e-f84f-491a-bbad-74519316c6d9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ee91c-101a-4c41-9d36-2ae7f2a25864]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a4318-6b77-48e4-ba74-9f2550d87175]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc521e2f-402b-4654-89ad-b57c3885f589]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260]
Nov 15 18:44:31 user nova-compute[75634]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167fe00-4119-4127-8d90-f161846028dd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== disconnect_volume: return (376ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-76e89058-de98-4d94-a8b8-73c8a9e60ec7 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.899s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.784s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:32 user nova-compute[75634]: INFO nova.compute.manager [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Terminating instance
Nov 15 18:44:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-unplugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] No waiting events found dispatching network-vif-unplugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-1d6b3ca0-9d9c-4939-abbf-b205154977ab req-fafa999c-9edc-4d77-9ee7-e8f9a1277101 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-unplugged-40106406-5d49-4704-8ec4-ee3f09af1869 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Instance destroyed successfully.
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'resources' on Instance uuid 54932a79-b9a3-4735-a317-a4b2b5a38443 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1789050795',display_name='tempest-VolumesSnapshotTestJSON-instance-1789050795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1789050795',id=20,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8GQZQDQ2yUx/FdK6bE+Rt5sXQEpLLOgh5M27pPRhTePxPKISGq6kdzSiKW+WFolTbdZJcxlkIGsl0udcEgyYveVDsAB1IiqG8Z7EJ0WzB7cU8CVGVqbvBYNi7QAedS+Q==',key_name='tempest-keypair-1638587469',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-d0m5uwrc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=54932a79-b9a3-4735-a317-a4b2b5a38443,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "40106406-5d49-4704-8ec4-ee3f09af1869", "address": "fa:16:3e:11:7d:7a", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40106406-5d", "ovs_interfaceid": "40106406-5d49-4704-8ec4-ee3f09af1869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_vif [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40106406-5d, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aa0ec83-00a4-4640-8af0-1ef9262bb299) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:33 user nova-compute[75634]: INFO os_vif [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:7d:7a,bridge_name='br-int',has_traffic_filtering=True,id=40106406-5d49-4704-8ec4-ee3f09af1869,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40106406-5d')
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iayoGQcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:33 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cbbddb-a6cb-47b1-ab2e-403fcdaffd3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:44:33 user nova-compute[75634]: No targets found.
Nov 15 18:44:33 user nova-compute[75634]: iSNS:
Nov 15 18:44:33 user nova-compute[75634]: No targets found.
Nov 15 18:44:33 user nova-compute[75634]: STATIC:
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:44:33 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:33 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:33 user nova-compute[75634]: FIRMWARE:
Nov 15 18:44:33 user nova-compute[75634]: No targets found.
Nov 15 18:44:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:44:33 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:44:33 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64a924cb-4628-4c5e-b018-c95126d6aa48', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba5c5c-2462-472b-8cd8-2ec4f4629e1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d5963b-b467-4de7-abfd-62d505e56e5b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f78d603-b2d9-4ee8-b349-b7eb8a45ea33 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:33 user nova-compute[75634]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79643db8-3cc0-4974-9bfa-65107bc847d3 (non-flash)
Nov 15 18:44:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b681bc670>, {}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Disconnecting from: [] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== disconnect_volume: return (96ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:44:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Deleting instance files /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443_del
Nov 15 18:44:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Deletion of /opt/stack/data/nova/instances/54932a79-b9a3-4735-a317-a4b2b5a38443_del complete
Nov 15 18:44:33 user nova-compute[75634]: INFO nova.compute.manager [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 15 18:44:33 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:44:33 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.compute.manager [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Detaching volume 5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.virt.block_device [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attempting to driver detach volume 5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b from mountpoint /dev/vdb
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Attempting to detach device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:34 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:34 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:44:34 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:34 user nova-compute[75634]:   <serial>5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b</serial>
Nov 15 18:44:34 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:34 user nova-compute[75634]: </disk>
Nov 15 18:44:34 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config.
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:44:34 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:44:34 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:44:34 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:44:34 user nova-compute[75634]:   <serial>5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b</serial>
Nov 15 18:44:34 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:44:34 user nova-compute[75634]: </disk>
Nov 15 18:44:34 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-40a1d901-766b-41dd-b185-6f7b9d844bd5 req-9d6d0575-3c9a-4075-940d-db06658faf3c service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-deleted-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.compute.manager [req-40a1d901-766b-41dd-b185-6f7b9d844bd5 req-9d6d0575-3c9a-4075-940d-db06658faf3c service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Neutron deleted interface 40106406-5d49-4704-8ec4-ee3f09af1869; detaching it from the instance and deleting it from the info cache
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.network.neutron [req-40a1d901-766b-41dd-b185-6f7b9d844bd5 req-9d6d0575-3c9a-4075-940d-db06658faf3c service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Took 1.06 seconds to deallocate network for instance.
Nov 15 18:44:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-40a1d901-766b-41dd-b185-6f7b9d844bd5 req-9d6d0575-3c9a-4075-940d-db06658faf3c service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Detach interface failed, port_id=40106406-5d49-4704-8ec4-ee3f09af1869, reason: Instance 54932a79-b9a3-4735-a317-a4b2b5a38443 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:44:34 user nova-compute[75634]: WARNING nova.volume.cinder [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Attachment 344e77cf-3ff2-4a7f-8aba-30793bc56c33 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 344e77cf-3ff2-4a7f-8aba-30793bc56c33. (HTTP 404) (Request-ID: req-ab8f53b0-807c-492a-8e35-cdbc3c278ef3)
Nov 15 18:44:34 user nova-compute[75634]: INFO nova.compute.manager [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 18:44:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] Acquiring lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] No waiting events found dispatching network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:44:35 user nova-compute[75634]: WARNING nova.compute.manager [req-2237236e-dfd8-4c62-bdd2-ad6a5198af13 req-dc7e32ca-e96e-4287-94aa-4d808d74dea0 service nova] [instance: 54932a79-b9a3-4735-a317-a4b2b5a38443] Received unexpected event network-vif-plugged-40106406-5d49-4704-8ec4-ee3f09af1869 for instance with vm_state deleted and task_state None.
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:35 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Deleted allocations for instance 54932a79-b9a3-4735-a317-a4b2b5a38443
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0db2b3bd-cc1c-4af9-b10f-7c94ddbce528 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "54932a79-b9a3-4735-a317-a4b2b5a38443" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.862s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-changed-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Refreshing instance network info cache due to event network-changed-a0e5b165-2d33-428f-9ee5-4b9c27cea694. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] Acquiring lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] Acquired lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Refreshing network info cache for port a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:44:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:36 user nova-compute[75634]: INFO nova.compute.manager [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Terminating instance
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updated VIF entry in instance network info cache for port a0e5b165-2d33-428f-9ee5-4b9c27cea694. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updating instance_info_cache with network_info: [{"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db331788-5d73-44d1-84b5-9779f5339803 req-71d41c75-8ffe-440f-ae31-7e78f15ce74b service nova] Releasing lock "refresh_cache-81ef9a69-0f1f-4b72-b74c-98805fe35031" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Instance destroyed successfully.
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'resources' on Instance uuid 81ef9a69-0f1f-4b72-b74c-98805fe35031 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-291850120',display_name='tempest-AttachVolumeNegativeTest-server-291850120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-291850120',id=23,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjXyCtgC562+y+oiZEEtBLrm/PzD8T6v4DzwItDjUNf3ogpKkZocYuIEIGb8AJ6kuqor4jCuo4xeDFsJUA3MW2VMXktfVttEFisDwj/5mkju4P3riyYXkxBlFjvke6vag==',key_name='tempest-keypair-621109244',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-1ce03c6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=81ef9a69-0f1f-4b72-b74c-98805fe35031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "address": "fa:16:3e:63:cd:be", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e5b165-2d", "ovs_interfaceid": "a0e5b165-2d33-428f-9ee5-4b9c27cea694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:44:36 user nova-compute[75634]: DEBUG os_vif [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e5b165-2d, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9b6fe93-0dd7-4d63-bea3-8a3f75ac8211) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:44:37 user nova-compute[75634]: INFO os_vif [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:cd:be,bridge_name='br-int',has_traffic_filtering=True,id=a0e5b165-2d33-428f-9ee5-4b9c27cea694,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e5b165-2d')
Nov 15 18:44:37 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Deleting instance files /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031_del
Nov 15 18:44:37 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Deletion of /opt/stack/data/nova/instances/81ef9a69-0f1f-4b72-b74c-98805fe35031_del complete
Nov 15 18:44:37 user nova-compute[75634]: INFO nova.compute.manager [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-unplugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] No waiting events found dispatching network-vif-unplugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-unplugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Acquiring lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] No waiting events found dispatching network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:44:37 user nova-compute[75634]: WARNING nova.compute.manager [req-93223b33-5ea7-406c-99c5-26d38545b4cb req-01e14947-04f5-41f8-a8c0-c43413d3c344 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received unexpected event network-vif-plugged-a0e5b165-2d33-428f-9ee5-4b9c27cea694 for instance with vm_state active and task_state deleting.
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:37 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Took 0.83 seconds to deallocate network for instance.
Nov 15 18:44:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-faf751a1-6887-4412-9d2f-a99a2d2fdab7 req-72ce46b7-4b89-436a-980e-c9a9c6671087 service nova] [instance: 81ef9a69-0f1f-4b72-b74c-98805fe35031] Received event network-vif-deleted-a0e5b165-2d33-428f-9ee5-4b9c27cea694 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:38 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Deleted allocations for instance 81ef9a69-0f1f-4b72-b74c-98805fe35031
Nov 15 18:44:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6ff5fe7e-a779-4fb3-b0eb-59868b2c3abc tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "81ef9a69-0f1f-4b72-b74c-98805fe35031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e76c80e0-0538-428d-bd3c-07985d8205cc is timed out.
Nov 15 18:44:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully detached device vdb from instance e76c80e0-0538-428d-bd3c-07985d8205cc from the live domain config.
Nov 15 18:44:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbBWeIrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c90232-9e86-4ab6-a004-c31279024715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:44:40 user nova-compute[75634]: No targets found.
Nov 15 18:44:40 user nova-compute[75634]: iSNS:
Nov 15 18:44:40 user nova-compute[75634]: No targets found.
Nov 15 18:44:40 user nova-compute[75634]: STATIC:
Nov 15 18:44:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1
Nov 15 18:44:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b
Nov 15 18:44:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:44:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:44:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:40 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:44:40 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:40 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:40 user nova-compute[75634]: FIRMWARE:
Nov 15 18:44:40 user nova-compute[75634]: No targets found.
Nov 15 18:44:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:44:40 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:44:40 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501331d-eb9e-46ea-a39b-56f5b132c3e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ac2db-9f4c-42cb-9c6b-d0730e9c188e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 (non-flash)
Nov 15 18:44:40 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68107c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2e861-87e6-4d25-9ba6-194771be136a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d17b6-d6c5-4042-b9f6-9378d5265818]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56952cd-0fb4-47e8-96e9-f41d084c3046]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f8b950-80e6-472e-81f1-7a7c7cbce82d]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[639817bc-9dbc-4216-b8b7-12520402b63c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719000c-f1f7-4519-88cf-03c424738d18]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260]
Nov 15 18:44:40 user nova-compute[75634]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1f9869-a5cd-4cc9-bccf-9874f7c531c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48317e9-0226-4a3b-bdaa-866eb0b55fbd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== disconnect_volume: return (328ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6888179c-4e1e-439a-a674-100350828b6a tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:44:47 user nova-compute[75634]: INFO nova.compute.claims [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Claim successful on node user
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:44:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:44:48 user nova-compute[75634]: DEBUG nova.policy [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000d54e8a82d48b58f554ae085a4dab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17eb80780ad4231889417dab82ea2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:44:48 user nova-compute[75634]: INFO nova.virt.block_device [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Booting with blank volume at /dev/vda
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Successfully created port: cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Successfully updated port: cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-changed-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Refreshing instance network info cache due to event network-changed-cb2f6f12-998b-4f5b-9e86-d068d4dedd31. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:44:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance network_info: |[{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Refreshing network info cache for port cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updated VIF entry in instance network info cache for port cb2f6f12-998b-4f5b-9e86-d068d4dedd31. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:44:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd22ca4d-486d-4937-a9c3-a9e0b85f71d7 req-38342c42-7240-4856-886d-4f99d63b3e2c service nova] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:44:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.utils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0c839-64b5-4fa0-854f-3426cc6a06e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba0361-ed55-41e9-bb20-20883a593a3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f5d3b8-5d0b-45f7-9448-00b81b2169b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ccec6-967a-444c-ac77-17da9a25a32a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:44:54 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:44:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac98ca52-2752-49aa-8e15-e43d6fa48e0f]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG os_brick.utils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:54 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating existing volume attachment record: 7b9e3f11-571a-4ccf-ad1f-85865f662b62 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f is timed out.
Nov 15 18:44:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config.
Nov 15 18:44:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evPAxJow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:55 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27fbe9-4f61-4864-baec-ac6aecc53d50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:44:55 user nova-compute[75634]: No targets found.
Nov 15 18:44:55 user nova-compute[75634]: iSNS:
Nov 15 18:44:55 user nova-compute[75634]: No targets found.
Nov 15 18:44:55 user nova-compute[75634]: STATIC:
Nov 15 18:44:55 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b
Nov 15 18:44:55 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:55 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:55 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:44:55 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:55 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:55 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:44:55 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:55 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:55 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:44:55 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:44:55 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:44:55 user nova-compute[75634]: FIRMWARE:
Nov 15 18:44:55 user nova-compute[75634]: No targets found.
Nov 15 18:44:55 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:44:55 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:44:55 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1aa430-3412-410c-96f4-d707b0ea9d10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb52291a-24f1-47ae-a3cb-735e829a1e4d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:55 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:55 user nova-compute[75634]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b (non-flash)
Nov 15 18:44:55 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4433feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed27e89-873d-4b2f-8207-3a5793e63b40]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[58232749-8c69-4e27-9928-36586ad75d55]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[555a4864-17e2-4b04-9152-e6086f5016b8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a55cff1-31b9-4a63-8095-fc357dbfeb26]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e25605-0c44-40a0-8cca-96c1a72ab35a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcbd086-8e89-4e6d-bf13-2581536cf4f9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260]
Nov 15 18:44:55 user nova-compute[75634]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:55 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9f36e0-bfdd-49b3-a1f6-e99f0c358f4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea05dd-f788-47b4-80ea-a26c4c6326f6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== disconnect_volume: return (367ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:44:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:44:56 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:44:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8f343b17-34ff-4353-aa0b-ae5d054af917 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.019s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:44:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Creating image(s)
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Ensure instance console log exists: /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start _get_guest_xml network_info=[{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ecd19a3-6712-411c-94fe-bdc95fc2b28c', 'attached_at': '', 'detached_at': '', 'volume_id': '6ab816fd-fb1d-4a4a-b41f-86983a223358', 'serial': '6ab816fd-fb1d-4a4a-b41f-86983a223358'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '7b9e3f11-571a-4ccf-ad1f-85865f662b62', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:44:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:44:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:44:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:44:59 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3aac5-2931-49a8-b3d7-22f5718c221f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:44:59 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[374df95e-e929-4544-a727-e63d40736977]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358] added
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02d4d45-92fa-4e22-9f4d-0b20e0194a1f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ba714-8c70-4ff7-9c33-70ad2afc84d0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrLnmHVl {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrLnmHVl" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e274c-777a-4e46-924c-2074f98060e4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrLnmHVl'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8264b1-3a74-42b7-bc20-9df7e30d08a6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d4479-19ef-4c15-a5b8-ca82e91eb235]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b5745-4a34-491c-b743-25d24ae5576b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260]
Nov 15 18:44:59 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260] successful.
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f47dbe2-1aba-4fcc-8931-80c8921e50b7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1227be4e-898f-4b2d-92e4-998c8098b5e3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:44:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9fbc06-29e1-4eaf-be02-2c438a37546a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:44:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23036326663653337', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036326663653337', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1145365935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1145365935',id=25,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-elq2iktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:44:48Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=0ecd19a3-6712-411c-94fe-bdc95fc2b28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:00 user nova-compute[75634]:   <uuid>0ecd19a3-6712-411c-94fe-bdc95fc2b28c</uuid>
Nov 15 18:45:00 user nova-compute[75634]:   <name>instance-00000019</name>
Nov 15 18:45:00 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:00 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:00 user nova-compute[75634]:   <metadata>
Nov 15 18:45:00 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:00 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1145365935</nova:name>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:44:59</nova:creationTime>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:00 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:00 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:45:00 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:45:00 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:00 user nova-compute[75634]:         <nova:port uuid="cb2f6f12-998b-4f5b-9e86-d068d4dedd31">
Nov 15 18:45:00 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:45:00 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:00 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:00 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:00 user nova-compute[75634]:   </metadata>
Nov 15 18:45:00 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:00 user nova-compute[75634]:     <system>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="serial">0ecd19a3-6712-411c-94fe-bdc95fc2b28c</entry>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="uuid">0ecd19a3-6712-411c-94fe-bdc95fc2b28c</entry>
Nov 15 18:45:00 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:00 user nova-compute[75634]:     </system>
Nov 15 18:45:00 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:00 user nova-compute[75634]:   <os>
Nov 15 18:45:00 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:00 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:00 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:00 user nova-compute[75634]:   </os>
Nov 15 18:45:00 user nova-compute[75634]:   <features>
Nov 15 18:45:00 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:00 user nova-compute[75634]:     <apic/>
Nov 15 18:45:00 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:00 user nova-compute[75634]:   </features>
Nov 15 18:45:00 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:00 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:00 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:00 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:00 user nova-compute[75634]:   </clock>
Nov 15 18:45:00 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:00 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:00 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:00 user nova-compute[75634]:   </cpu>
Nov 15 18:45:00 user nova-compute[75634]:   <devices>
Nov 15 18:45:00 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:45:00 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:00 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 18:45:00 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:00 user nova-compute[75634]:       <serial>6ab816fd-fb1d-4a4a-b41f-86983a223358</serial>
Nov 15 18:45:00 user nova-compute[75634]:     </disk>
Nov 15 18:45:00 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:00 user nova-compute[75634]:       <mac address="fa:16:3e:05:c3:10"/>
Nov 15 18:45:00 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:00 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:00 user nova-compute[75634]:       <target dev="tapcb2f6f12-99"/>
Nov 15 18:45:00 user nova-compute[75634]:     </interface>
Nov 15 18:45:00 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:00 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/console.log" append="off"/>
Nov 15 18:45:00 user nova-compute[75634]:     </serial>
Nov 15 18:45:00 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:00 user nova-compute[75634]:     <video>
Nov 15 18:45:00 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:00 user nova-compute[75634]:     </video>
Nov 15 18:45:00 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:00 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:00 user nova-compute[75634]:     </rng>
Nov 15 18:45:00 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:00 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:00 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:00 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:00 user nova-compute[75634]:   </devices>
Nov 15 18:45:00 user nova-compute[75634]: </domain>
Nov 15 18:45:00 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1145365935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1145365935',id=25,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-elq2iktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:44:48Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=0ecd19a3-6712-411c-94fe-bdc95fc2b28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG os_vif [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e0ef315-d983-500a-9970-0416b073dcbf', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb2f6f12-99, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb2f6f12-99, col_values=(('qos', UUID('6711455d-5fec-49b5-9528-6fb9c4a0a311')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb2f6f12-99, col_values=(('external_ids', {'iface-id': 'cb2f6f12-998b-4f5b-9e86-d068d4dedd31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c3:10', 'vm-uuid': '0ecd19a3-6712-411c-94fe-bdc95fc2b28c'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:00 user nova-compute[75634]: INFO os_vif [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99')
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:05:c3:10, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance spawned successfully.
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:04 user nova-compute[75634]: INFO nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:04 user nova-compute[75634]: INFO nova.compute.manager [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Took 17.21 seconds to build instance.
Nov 15 18:45:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-28c8feae-2941-4f21-ac2c-7d5b3197da6f tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.388s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:05 user nova-compute[75634]: WARNING nova.compute.manager [req-80900ab5-4869-4aa2-ab11-e24713fe95f9 req-01d50413-8c99-4312-8af6-5b6a8c5926d1 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state active and task_state None.
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:45:05 user nova-compute[75634]: INFO nova.compute.claims [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Claim successful on node user
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:45:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.policy [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395915213ac442edbdd3d80e03367744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfe1f0276a74611b6cf863fa909aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:45:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Creating image(s)
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:45:05 user nova-compute[75634]: INFO nova.compute.claims [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Claim successful on node user
Nov 15 18:45:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Successfully created port: 07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk 1073741824" returned: 0 in 0.063s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:45:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Cannot resize image /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Ensure instance console log exists: /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.policy [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395915213ac442edbdd3d80e03367744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfe1f0276a74611b6cf863fa909aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:45:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Creating image(s)
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:07 user nova-compute[75634]: WARNING nova.compute.manager [req-cd1cb584-78e3-43d8-b586-d64f1e3959d3 req-cf10a8de-8d2e-4322-bdd8-94b06013562c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state active and task_state None.
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Successfully updated port: 07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:07 user nova-compute[75634]: INFO nova.compute.manager [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Terminating instance
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-changed-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Refreshing instance network info cache due to event network-changed-07777476-904a-462a-b52f-17f75c58f2ff. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Refreshing network info cache for port 07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.215s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk 1073741824" returned: 0 in 0.127s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Successfully created port: 4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:07 user nova-compute[75634]: INFO nova.compute.manager [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Terminating instance
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.232s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Cannot resize image /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Ensure instance console log exists: /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db0db0c4-6bac-4645-b9c8-51a845e8717f req-c5619c96-faa4-4948-86d8-1d0edb952440 service nova] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:07 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-14bffa9c-1db6-4500-8e1a-496e50202eaf req-7809fd6b-b193-4ec9-8f2d-aa51a951122a service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Instance destroyed successfully.
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lazy-loading 'resources' on Instance uuid b5ea2fd0-4c87-410a-bd2c-9215f1dc0016 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-310558690',display_name='tempest-ServersNegativeTestJSON-server-310558690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-310558690',id=1,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efda14818c224f2382438fcf2c1c39c5',ramdisk_id='',reservation_id='r-jnb7hd8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1798425367',owner_user_name='tempest-ServersNegativeTestJSON-1798425367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:36:46Z,user_data=None,user_id='099e827d7f0847fba5644d6f5eef6743',uuid=b5ea2fd0-4c87-410a-bd2c-9215f1dc0016,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converting VIF {"id": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "address": "fa:16:3e:05:17:fe", "network": {"id": "9521a03d-0bf8-4c9d-80c9-5f681ab832f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41455450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efda14818c224f2382438fcf2c1c39c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b9a43a-f3", "ovs_interfaceid": "89b9a43a-f31f-484e-9f87-2e18abbf17cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_vif [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89b9a43a-f3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Instance destroyed successfully.
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lazy-loading 'resources' on Instance uuid 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d87f1c9-4663-484d-ad79-ace67a4efa91) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2001600215',display_name='tempest-ServerActionsTestOtherB-server-2001600215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2001600215',id=3,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKppdMK/NjWdSrME1bvYJLhMSBvkCzTNfqcQ420shPXsBXJgle/RvuwtRDDJqeSmCVbl2koES7J7UckPTRLUdiOI1pn6KSnE0x+/xjXLeyb1lUE9WEVmSD86v5KbgKAUg==',key_name='tempest-keypair-98796012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bed672b3528475bb3bbe7f4eecfd7c5',ramdisk_id='',reservation_id='r-j0o9g0rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1858282954',owner_user_name='tempest-ServerActionsTestOtherB-1858282954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32a76663d88d4a4ea090919a67c801a8',uuid=46998ac1-8bf2-4277-a9cd-f8ecf53c5576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converting VIF {"id": "3788bac0-17f5-41ed-889d-2649ea453783", "address": "fa:16:3e:96:86:92", "network": {"id": "cefc24f2-1aef-4697-bad7-50b653c69983", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1889895319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bed672b3528475bb3bbe7f4eecfd7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3788bac0-17", "ovs_interfaceid": "3788bac0-17f5-41ed-889d-2649ea453783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_vif [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Successfully updated port: 4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3788bac0-17, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:08 user nova-compute[75634]: INFO os_vif [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:17:fe,bridge_name='br-int',has_traffic_filtering=True,id=89b9a43a-f31f-484e-9f87-2e18abbf17cf,network=Network(9521a03d-0bf8-4c9d-80c9-5f681ab832f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b9a43a-f3')
Nov 15 18:45:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Deleting instance files /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016_del
Nov 15 18:45:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Deletion of /opt/stack/data/nova/instances/b5ea2fd0-4c87-410a-bd2c-9215f1dc0016_del complete
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=650e13ce-ece5-4f40-b1c7-206442e734f5) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: INFO os_vif [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:86:92,bridge_name='br-int',has_traffic_filtering=True,id=3788bac0-17f5-41ed-889d-2649ea453783,network=Network(cefc24f2-1aef-4697-bad7-50b653c69983),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3788bac0-17')
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UevkjIJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:08 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9610f64-fb5b-4972-a851-c904903a2ef0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:45:08 user nova-compute[75634]: No targets found.
Nov 15 18:45:08 user nova-compute[75634]: iSNS:
Nov 15 18:45:08 user nova-compute[75634]: No targets found.
Nov 15 18:45:08 user nova-compute[75634]: STATIC:
Nov 15 18:45:08 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a
Nov 15 18:45:08 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:08 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:08 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:45:08 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:08 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:08 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:45:08 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:08 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:08 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:45:08 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:08 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:08 user nova-compute[75634]: FIRMWARE:
Nov 15 18:45:08 user nova-compute[75634]: No targets found.
Nov 15 18:45:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:45:08 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:45:08 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.neutron [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:08 user nova-compute[75634]: INFO nova.compute.manager [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[853137d8-2157-44b8-a55e-c1159c6ce324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance network_info: |[{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start _get_guest_xml network_info=[{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:45:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8ff9a-9108-4ef9-9777-9fc795e55b85]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68106b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099763569',display_name='tempest-ServerRescueNegativeTestJSON-server-1099763569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099763569',id=26,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-s2hga7f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:06Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=dbc304fa-0f5f-44b9-9dca-8f39d59a157e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.objects.instance [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f521685-8b0c-44d7-91fb-ae9befe74f0c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:08 user nova-compute[75634]:   <uuid>dbc304fa-0f5f-44b9-9dca-8f39d59a157e</uuid>
Nov 15 18:45:08 user nova-compute[75634]:   <name>instance-0000001a</name>
Nov 15 18:45:08 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:08 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:08 user nova-compute[75634]:   <metadata>
Nov 15 18:45:08 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:08 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1099763569</nova:name>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:45:08</nova:creationTime>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:08 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:08 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:45:08 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:45:08 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:08 user nova-compute[75634]:         <nova:port uuid="07777476-904a-462a-b52f-17f75c58f2ff">
Nov 15 18:45:08 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:45:08 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:08 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:08 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:08 user nova-compute[75634]:   </metadata>
Nov 15 18:45:08 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:08 user nova-compute[75634]:     <system>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="serial">dbc304fa-0f5f-44b9-9dca-8f39d59a157e</entry>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="uuid">dbc304fa-0f5f-44b9-9dca-8f39d59a157e</entry>
Nov 15 18:45:08 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:08 user nova-compute[75634]:     </system>
Nov 15 18:45:08 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:08 user nova-compute[75634]:   <os>
Nov 15 18:45:08 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:08 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:08 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:08 user nova-compute[75634]:   </os>
Nov 15 18:45:08 user nova-compute[75634]:   <features>
Nov 15 18:45:08 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:08 user nova-compute[75634]:     <apic/>
Nov 15 18:45:08 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:08 user nova-compute[75634]:   </features>
Nov 15 18:45:08 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:08 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:08 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:08 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:08 user nova-compute[75634]:   </clock>
Nov 15 18:45:08 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:08 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:08 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:08 user nova-compute[75634]:   </cpu>
Nov 15 18:45:08 user nova-compute[75634]:   <devices>
Nov 15 18:45:08 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:45:08 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:45:08 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk"/>
Nov 15 18:45:08 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:08 user nova-compute[75634]:     </disk>
Nov 15 18:45:08 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:08 user nova-compute[75634]:       <mac address="fa:16:3e:70:08:ff"/>
Nov 15 18:45:08 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:08 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:08 user nova-compute[75634]:       <target dev="tap07777476-90"/>
Nov 15 18:45:08 user nova-compute[75634]:     </interface>
Nov 15 18:45:08 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:08 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/console.log" append="off"/>
Nov 15 18:45:08 user nova-compute[75634]:     </serial>
Nov 15 18:45:08 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:08 user nova-compute[75634]:     <video>
Nov 15 18:45:08 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:08 user nova-compute[75634]:     </video>
Nov 15 18:45:08 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:08 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:08 user nova-compute[75634]:     </rng>
Nov 15 18:45:08 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:08 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:08 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:08 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:08 user nova-compute[75634]:   </devices>
Nov 15 18:45:08 user nova-compute[75634]: </domain>
Nov 15 18:45:08 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099763569',display_name='tempest-ServerRescueNegativeTestJSON-server-1099763569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099763569',id=26,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-s2hga7f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:06Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=dbc304fa-0f5f-44b9-9dca-8f39d59a157e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_vif [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16b94441-8604-50c6-844d-6f4943de4a58', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf2e0c7-f6d4-40c2-8818-809e92f25e96]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07777476-90, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07777476-90, col_values=(('qos', UUID('ae1a6479-89dc-4197-a65c-a8c25351cf0f')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07777476-90, col_values=(('external_ids', {'iface-id': '07777476-904a-462a-b52f-17f75c58f2ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:08:ff', 'vm-uuid': 'dbc304fa-0f5f-44b9-9dca-8f39d59a157e'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bd11a9-8009-4e69-959f-75ab819a1c1e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:08 user nova-compute[75634]: INFO os_vif [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90')
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080f2df-29aa-45e9-a5b0-3ff39c6b2d3d]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:70:08:ff, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91a690-3901-4d57-82cb-dac60ad64cab]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a4269-930e-428d-8d7a-6f7234b67eae]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260]
Nov 15 18:45:08 user nova-compute[75634]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a, portal: 172.16.0.220,3260] successful.
Nov 15 18:45:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:599af8bc-18bc-4b32-90ca-ae1a5443109a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ceca19-67e1-4199-92d2-1ddaddd4ffff]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] <== disconnect_volume: return (391ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:45:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Deleting instance files /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_del
Nov 15 18:45:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Deletion of /opt/stack/data/nova/instances/46998ac1-8bf2-4277-a9cd-f8ecf53c5576_del complete
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: INFO nova.compute.manager [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:09 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Took 0.50 seconds to deallocate network for instance.
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-81309a11-0f25-4c1c-89f3-1bd18ad42207 req-87207a30-3f13-4754-aff4-1e2c5e92e613 service nova] [instance: b5ea2fd0-4c87-410a-bd2c-9215f1dc0016] Received event network-vif-deleted-89b9a43a-f31f-484e-9f87-2e18abbf17cf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance network_info: |[{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start _get_guest_xml network_info=[{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:45:09 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:09 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936047067',display_name='tempest-ServerRescueNegativeTestJSON-server-936047067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936047067',id=27,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-muy1q36q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:07Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:09 user nova-compute[75634]:   <uuid>8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</uuid>
Nov 15 18:45:09 user nova-compute[75634]:   <name>instance-0000001b</name>
Nov 15 18:45:09 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:09 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:09 user nova-compute[75634]:   <metadata>
Nov 15 18:45:09 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:09 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-936047067</nova:name>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:45:09</nova:creationTime>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:09 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:09 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:45:09 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:45:09 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:09 user nova-compute[75634]:         <nova:port uuid="4e3260a7-c46e-48a2-85a0-b67464a58563">
Nov 15 18:45:09 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:45:09 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:09 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:09 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:09 user nova-compute[75634]:   </metadata>
Nov 15 18:45:09 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:09 user nova-compute[75634]:     <system>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="serial">8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</entry>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="uuid">8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</entry>
Nov 15 18:45:09 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:09 user nova-compute[75634]:     </system>
Nov 15 18:45:09 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:09 user nova-compute[75634]:   <os>
Nov 15 18:45:09 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:09 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:09 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:09 user nova-compute[75634]:   </os>
Nov 15 18:45:09 user nova-compute[75634]:   <features>
Nov 15 18:45:09 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:09 user nova-compute[75634]:     <apic/>
Nov 15 18:45:09 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:09 user nova-compute[75634]:   </features>
Nov 15 18:45:09 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:09 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:09 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:09 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:09 user nova-compute[75634]:   </clock>
Nov 15 18:45:09 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:09 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:09 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:09 user nova-compute[75634]:   </cpu>
Nov 15 18:45:09 user nova-compute[75634]:   <devices>
Nov 15 18:45:09 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:45:09 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:45:09 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk"/>
Nov 15 18:45:09 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:09 user nova-compute[75634]:     </disk>
Nov 15 18:45:09 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:09 user nova-compute[75634]:       <mac address="fa:16:3e:d3:4c:ed"/>
Nov 15 18:45:09 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:09 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:09 user nova-compute[75634]:       <target dev="tap4e3260a7-c4"/>
Nov 15 18:45:09 user nova-compute[75634]:     </interface>
Nov 15 18:45:09 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:09 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/console.log" append="off"/>
Nov 15 18:45:09 user nova-compute[75634]:     </serial>
Nov 15 18:45:09 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:09 user nova-compute[75634]:     <video>
Nov 15 18:45:09 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:09 user nova-compute[75634]:     </video>
Nov 15 18:45:09 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:09 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:09 user nova-compute[75634]:     </rng>
Nov 15 18:45:09 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:09 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:09 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:09 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:09 user nova-compute[75634]:   </devices>
Nov 15 18:45:09 user nova-compute[75634]: </domain>
Nov 15 18:45:09 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936047067',display_name='tempest-ServerRescueNegativeTestJSON-server-936047067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936047067',id=27,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-muy1q36q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:07Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG os_vif [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b61b1b5d-3eab-5cd9-a90b-460084678689', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e3260a7-c4, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e3260a7-c4, col_values=(('qos', UUID('da24f246-376c-4768-9b8e-c344ccd13ba5')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e3260a7-c4, col_values=(('external_ids', {'iface-id': '4e3260a7-c46e-48a2-85a0-b67464a58563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:4c:ed', 'vm-uuid': '8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:09 user nova-compute[75634]: INFO os_vif [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4')
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:d3:4c:ed, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:09 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Deleted allocations for instance b5ea2fd0-4c87-410a-bd2c-9215f1dc0016
Nov 15 18:45:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3e7ffee8-cef0-4904-a9e9-e481ff06fa78 tempest-ServersNegativeTestJSON-1798425367 tempest-ServersNegativeTestJSON-1798425367-project-member] Lock "b5ea2fd0-4c87-410a-bd2c-9215f1dc0016" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.600s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:10 user nova-compute[75634]: WARNING nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state deleting.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-changed-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Refreshing instance network info cache due to event network-changed-4e3260a7-c46e-48a2-85a0-b67464a58563. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquired lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Refreshing network info cache for port 4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: INFO nova.compute.manager [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Detaching volume adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:45:10 user nova-compute[75634]: INFO nova.virt.block_device [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Attempting to driver detach volume adc5a166-a8c2-4e98-aae8-2a643ca432a2 from mountpoint /dev/vdb
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Attempting to detach device vdb from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:10 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:10 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:45:10 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:10 user nova-compute[75634]:   <serial>adc5a166-a8c2-4e98-aae8-2a643ca432a2</serial>
Nov 15 18:45:10 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:45:10 user nova-compute[75634]: </disk>
Nov 15 18:45:10 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully detached device vdb from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the persistent domain config.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:10 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:10 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:45:10 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:10 user nova-compute[75634]:   <serial>adc5a166-a8c2-4e98-aae8-2a643ca432a2</serial>
Nov 15 18:45:10 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:45:10 user nova-compute[75634]: </disk>
Nov 15 18:45:10 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updated VIF entry in instance network info cache for port 4e3260a7-c46e-48a2-85a0-b67464a58563. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Releasing lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:10 user nova-compute[75634]: WARNING nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state deleting.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:10 user nova-compute[75634]: WARNING nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state deleting.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-unplugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Acquiring lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] No waiting events found dispatching network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:10 user nova-compute[75634]: WARNING nova.compute.manager [req-1c230a38-8699-4470-952f-ed9ce06bfd6f req-aee1eeec-e244-430d-bd19-54bff106f114 service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received unexpected event network-vif-plugged-3788bac0-17f5-41ed-889d-2649ea453783 for instance with vm_state active and task_state deleting.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-df911b16-5e53-4d43-b854-b056999d617d req-995ceb20-3233-4865-acf0-28e653ae9d6f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Received event network-vif-deleted-3788bac0-17f5-41ed-889d-2649ea453783 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:10 user nova-compute[75634]: INFO nova.compute.manager [req-df911b16-5e53-4d43-b854-b056999d617d req-995ceb20-3233-4865-acf0-28e653ae9d6f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Neutron deleted interface 3788bac0-17f5-41ed-889d-2649ea453783; detaching it from the instance and deleting it from the info cache
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-df911b16-5e53-4d43-b854-b056999d617d req-995ceb20-3233-4865-acf0-28e653ae9d6f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:10 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Took 1.54 seconds to deallocate network for instance.
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-df911b16-5e53-4d43-b854-b056999d617d req-995ceb20-3233-4865-acf0-28e653ae9d6f service nova] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Detach interface failed, port_id=3788bac0-17f5-41ed-889d-2649ea453783, reason: Instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:11 user nova-compute[75634]: WARNING nova.compute.manager [req-c4c060a5-604c-47ab-9265-4a1e77cce82c req-47e96809-c33e-445e-b8bc-a6524c913f21 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state building and task_state spawning.
Nov 15 18:45:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:11 user nova-compute[75634]: INFO nova.compute.manager [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] [instance: 46998ac1-8bf2-4277-a9cd-f8ecf53c5576] Took 0.97 seconds to detach 1 volumes for instance.
Nov 15 18:45:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:12 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Deleted allocations for instance 46998ac1-8bf2-4277-a9cd-f8ecf53c5576
Nov 15 18:45:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2258f08d-bd52-4ccb-9dcd-546ee077b7fb tempest-ServerActionsTestOtherB-1858282954 tempest-ServerActionsTestOtherB-1858282954-project-member] Lock "46998ac1-8bf2-4277-a9cd-f8ecf53c5576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.601s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:12 user nova-compute[75634]: WARNING nova.compute.manager [req-05559a44-0760-4c2d-b90e-a53b3047266c req-5e62dd0d-92d1-4bd6-ac6c-6a5176b44a1f service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state building and task_state spawning.
Nov 15 18:45:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:13 user nova-compute[75634]: WARNING nova.compute.manager [req-725188a7-42e5-44df-9c37-15a822b62e9a req-7fd8a39c-c2bb-4582-979b-5daeb83cccf9 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state building and task_state spawning.
Nov 15 18:45:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.compute.manager [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] instance snapshotting
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Beginning live snapshot process
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance spawned successfully.
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance spawned successfully.
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Took 8.84 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Took 7.81 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:14 user nova-compute[75634]: WARNING nova.compute.manager [req-18e9e722-2cec-4d2f-abc5-92cbccafaa48 req-c8ba6b30-b24c-4c12-b3b3-6383c7a168ef service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state building and task_state spawning.
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.compute.manager [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Took 9.76 seconds to build instance.
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.compute.manager [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Took 8.99 seconds to build instance.
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba.delta 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-beabe3d3-30a5-412d-bef6-62675865414d tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.913s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c4978c02-5392-46ff-9087-b8dbe58bbd62 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.128s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba.delta 1073741824" returned: 0 in 0.055s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 18:45:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] COPY block job progress, current cursor: 19791872 final cursor: 75563008 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:45:16 user nova-compute[75634]: INFO nova.compute.claims [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Claim successful on node user
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:45:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba.delta /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:16 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:45:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba.delta /opt/stack/data/nova/instances/snapshots/tmpdskou0ic/8c7fadf1b3e0421bacd55e6b9fd779ba" returned: 0 in 0.514s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Snapshot extracted, beginning image upload
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.policy [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5ccd186caec4537a98be34699d1a1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb145ba27ca5420591deefadf264ff39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:45:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Creating image(s)
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "/opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "/opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk 1073741824" returned: 0 in 0.059s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Successfully created port: 3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Cannot resize image /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Ensure instance console log exists: /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Successfully updated port: 3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquired lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-changed-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Refreshing instance network info cache due to event network-changed-3d50b190-0038-4e32-bdd4-603337580f5b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] Acquiring lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updating instance_info_cache with network_info: [{"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Releasing lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Instance network_info: |[{"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] Acquired lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Refreshing network info cache for port 3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Start _get_guest_xml network_info=[{"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:45:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:19 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1909585895',display_name='tempest-VolumesSnapshotTestJSON-instance-1909585895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1909585895',id=28,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh5y1xPMS9VP9nMa2579oaTKx+xNy4er4aCkPkmGrvdwQMR4i4xGLDPE+4ChrjfdD7vzSGoZ9z/xpWf6nHboF09lt3/SXh/og0aLOLnq5VBxVS0LdcckKANUtv6A9yEuQ==',key_name='tempest-keypair-1493302441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-cd77uqj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=a6ea34f2-d151-4ddf-a905-a4e54b50cb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:19 user nova-compute[75634]:   <uuid>a6ea34f2-d151-4ddf-a905-a4e54b50cb95</uuid>
Nov 15 18:45:19 user nova-compute[75634]:   <name>instance-0000001c</name>
Nov 15 18:45:19 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:19 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:19 user nova-compute[75634]:   <metadata>
Nov 15 18:45:19 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:19 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1909585895</nova:name>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:45:19</nova:creationTime>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:19 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:19 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:user uuid="c5ccd186caec4537a98be34699d1a1a1">tempest-VolumesSnapshotTestJSON-2133351772-project-member</nova:user>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:project uuid="fb145ba27ca5420591deefadf264ff39">tempest-VolumesSnapshotTestJSON-2133351772</nova:project>
Nov 15 18:45:19 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:45:19 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:19 user nova-compute[75634]:         <nova:port uuid="3d50b190-0038-4e32-bdd4-603337580f5b">
Nov 15 18:45:19 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 18:45:19 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:19 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:19 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:19 user nova-compute[75634]:   </metadata>
Nov 15 18:45:19 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:19 user nova-compute[75634]:     <system>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="serial">a6ea34f2-d151-4ddf-a905-a4e54b50cb95</entry>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="uuid">a6ea34f2-d151-4ddf-a905-a4e54b50cb95</entry>
Nov 15 18:45:19 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:19 user nova-compute[75634]:     </system>
Nov 15 18:45:19 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:19 user nova-compute[75634]:   <os>
Nov 15 18:45:19 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:19 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:19 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:19 user nova-compute[75634]:   </os>
Nov 15 18:45:19 user nova-compute[75634]:   <features>
Nov 15 18:45:19 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:19 user nova-compute[75634]:     <apic/>
Nov 15 18:45:19 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:19 user nova-compute[75634]:   </features>
Nov 15 18:45:19 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:19 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:19 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:19 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:19 user nova-compute[75634]:   </clock>
Nov 15 18:45:19 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:19 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:19 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:19 user nova-compute[75634]:   </cpu>
Nov 15 18:45:19 user nova-compute[75634]:   <devices>
Nov 15 18:45:19 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:45:19 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:45:19 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk"/>
Nov 15 18:45:19 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:19 user nova-compute[75634]:     </disk>
Nov 15 18:45:19 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:19 user nova-compute[75634]:       <mac address="fa:16:3e:d4:95:09"/>
Nov 15 18:45:19 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:19 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:19 user nova-compute[75634]:       <target dev="tap3d50b190-00"/>
Nov 15 18:45:19 user nova-compute[75634]:     </interface>
Nov 15 18:45:19 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:19 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/console.log" append="off"/>
Nov 15 18:45:19 user nova-compute[75634]:     </serial>
Nov 15 18:45:19 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:19 user nova-compute[75634]:     <video>
Nov 15 18:45:19 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:19 user nova-compute[75634]:     </video>
Nov 15 18:45:19 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:19 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:19 user nova-compute[75634]:     </rng>
Nov 15 18:45:19 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:19 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:19 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:19 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:19 user nova-compute[75634]:   </devices>
Nov 15 18:45:19 user nova-compute[75634]: </domain>
Nov 15 18:45:19 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1909585895',display_name='tempest-VolumesSnapshotTestJSON-instance-1909585895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1909585895',id=28,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh5y1xPMS9VP9nMa2579oaTKx+xNy4er4aCkPkmGrvdwQMR4i4xGLDPE+4ChrjfdD7vzSGoZ9z/xpWf6nHboF09lt3/SXh/og0aLOLnq5VBxVS0LdcckKANUtv6A9yEuQ==',key_name='tempest-keypair-1493302441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-cd77uqj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=a6ea34f2-d151-4ddf-a905-a4e54b50cb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG os_vif [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52268c9a-a904-59af-aae8-79be1d38832d', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d50b190-00, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d50b190-00, col_values=(('qos', UUID('118dbe40-31d3-4a11-a725-65560ca8f6b5')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d50b190-00, col_values=(('external_ids', {'iface-id': '3d50b190-0038-4e32-bdd4-603337580f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:95:09', 'vm-uuid': 'a6ea34f2-d151-4ddf-a905-a4e54b50cb95'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:19 user nova-compute[75634]: INFO os_vif [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00')
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No VIF found with MAC fa:16:3e:d4:95:09, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updated VIF entry in instance network info cache for port 3d50b190-0038-4e32-bdd4-603337580f5b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG nova.network.neutron [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updating instance_info_cache with network_info: [{"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4a53c048-6825-4cf4-81ee-e5777d03174f req-0316e04c-56d2-48ac-9185-98cfa3150322 service nova] Releasing lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:20 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Snapshot image upload complete
Nov 15 18:45:20 user nova-compute[75634]: INFO nova.compute.manager [None req-368e57a7-cd5d-48de-92b5-ecbaac1a6241 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Took 6.75 seconds to snapshot the instance on the hypervisor.
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] No waiting events found dispatching network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:21 user nova-compute[75634]: WARNING nova.compute.manager [req-aff4fe6b-97c2-4092-9c1a-39476112812e req-9001bc62-47ba-4c41-a6e4-ae76916b8b45 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received unexpected event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b for instance with vm_state building and task_state spawning.
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:45:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] No waiting events found dispatching network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:23 user nova-compute[75634]: WARNING nova.compute.manager [req-a7c7c0d9-a548-4084-82c9-9dc0af5db135 req-a3a8c751-57e2-4852-8da0-69b154bfb64b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received unexpected event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b for instance with vm_state building and task_state spawning.
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Instance spawned successfully.
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:23 user nova-compute[75634]: INFO nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:23 user nova-compute[75634]: INFO nova.compute.manager [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Took 7.48 seconds to build instance.
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-59785780-cb52-4ef3-a49b-6522f7952c73 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.575s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:45:24 user nova-compute[75634]: INFO nova.compute.claims [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Claim successful on node user
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:45:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG nova.policy [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd17a4320e9264810ba96eba3fcd707cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eff43206fc5450ebe346f72798856f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:45:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Creating image(s)
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "/opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "/opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "/opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "0d3883111a7eff1707485a8be15904c0f553bffb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "0d3883111a7eff1707485a8be15904c0f553bffb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.006s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Successfully created port: 7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 1.596s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.virt.images [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] 459994c0-9b0f-4837-b848-1c101104180e was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.part /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.part /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.converted" returned: 0 in 0.559s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Successfully updated port: 7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquired lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing instance network info cache due to event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] Acquiring lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "0d3883111a7eff1707485a8be15904c0f553bffb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.719s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "0d3883111a7eff1707485a8be15904c0f553bffb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "0d3883111a7eff1707485a8be15904c0f553bffb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:28 user nova-compute[75634]: INFO nova.compute.manager [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Detaching volume 05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json" returned: 0 in 0.242s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb,backing_fmt=raw /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: INFO nova.virt.block_device [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Attempting to driver detach volume 05d4860c-b031-4cca-8210-4dad1ac07ab0 from mountpoint /dev/vdb
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Releasing lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Instance network_info: |[{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] Acquired lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb,backing_fmt=raw /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk 1073741824" returned: 0 in 0.076s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "0d3883111a7eff1707485a8be15904c0f553bffb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.216s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Attempting to detach device vdb from instance aa6bb849-3c0b-4ee5-9851-853c7cad944d from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:28 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:28 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:45:28 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:28 user nova-compute[75634]:   <serial>05d4860c-b031-4cca-8210-4dad1ac07ab0</serial>
Nov 15 18:45:28 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:45:28 user nova-compute[75634]: </disk>
Nov 15 18:45:28 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:28 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance aa6bb849-3c0b-4ee5-9851-853c7cad944d from the persistent domain config.
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa6bb849-3c0b-4ee5-9851-853c7cad944d from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:28 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:28 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:45:28 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:28 user nova-compute[75634]:   <serial>05d4860c-b031-4cca-8210-4dad1ac07ab0</serial>
Nov 15 18:45:28 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:45:28 user nova-compute[75634]: </disk>
Nov 15 18:45:28 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb --force-share --output=json" returned: 0 in 0.224s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Ensure instance console log exists: /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Start _get_guest_xml network_info=[{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bfc68c2be7485d1b656a50bf4c94c552',container_format='bare',created_at=2023-11-15T18:45:14Z,direct_url=<?>,disk_format='qcow2',id=459994c0-9b0f-4837-b848-1c101104180e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1891086509',owner='8eff43206fc5450ebe346f72798856f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T18:45:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '459994c0-9b0f-4837-b848-1c101104180e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:28 user nova-compute[75634]: INFO nova.compute.manager [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attaching volume 70328014-31b5-4290-96ba-cf858edd341b to /dev/vdb
Nov 15 18:45:28 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:28 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bfc68c2be7485d1b656a50bf4c94c552',container_format='bare',created_at=2023-11-15T18:45:14Z,direct_url=<?>,disk_format='qcow2',id=459994c0-9b0f-4837-b848-1c101104180e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1891086509',owner='8eff43206fc5450ebe346f72798856f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T18:45:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-111627372',display_name='tempest-TestStampPattern-server-111627372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-111627372',id=29,image_ref='459994c0-9b0f-4837-b848-1c101104180e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-qfmmy9tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e76c80e0-0538-428d-bd3c-07985d8205cc',image_min_disk='1',image_min_ram='0',image_owner_id='8eff43206fc5450ebe346f72798856f9',image_owner_project_name='tempest-TestStampPattern-326822497',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-326822497-project-member',image_user_id='d17a4320e9264810ba96eba3fcd707cf',network_allocated='True',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:25Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=2db80eba-1fb6-4671-b408-dc1acb70bc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.objects.instance [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'pci_devices' on Instance uuid 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG os_brick.utils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:28 user nova-compute[75634]:   <uuid>2db80eba-1fb6-4671-b408-dc1acb70bc69</uuid>
Nov 15 18:45:28 user nova-compute[75634]:   <name>instance-0000001d</name>
Nov 15 18:45:28 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:28 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:28 user nova-compute[75634]:   <metadata>
Nov 15 18:45:28 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:28 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:name>tempest-TestStampPattern-server-111627372</nova:name>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:45:28</nova:creationTime>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:28 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:28 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:user uuid="d17a4320e9264810ba96eba3fcd707cf">tempest-TestStampPattern-326822497-project-member</nova:user>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:project uuid="8eff43206fc5450ebe346f72798856f9">tempest-TestStampPattern-326822497</nova:project>
Nov 15 18:45:28 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:root type="image" uuid="459994c0-9b0f-4837-b848-1c101104180e"/>
Nov 15 18:45:28 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:28 user nova-compute[75634]:         <nova:port uuid="7c3fa923-7e34-4a58-a565-c8214f768996">
Nov 15 18:45:28 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:45:28 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:28 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:28 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:28 user nova-compute[75634]:   </metadata>
Nov 15 18:45:28 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:28 user nova-compute[75634]:     <system>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="serial">2db80eba-1fb6-4671-b408-dc1acb70bc69</entry>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="uuid">2db80eba-1fb6-4671-b408-dc1acb70bc69</entry>
Nov 15 18:45:28 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:28 user nova-compute[75634]:     </system>
Nov 15 18:45:28 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:28 user nova-compute[75634]:   <os>
Nov 15 18:45:28 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:28 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:28 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:28 user nova-compute[75634]:   </os>
Nov 15 18:45:28 user nova-compute[75634]:   <features>
Nov 15 18:45:28 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:28 user nova-compute[75634]:     <apic/>
Nov 15 18:45:28 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:28 user nova-compute[75634]:   </features>
Nov 15 18:45:28 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:28 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:28 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:28 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:28 user nova-compute[75634]:   </clock>
Nov 15 18:45:28 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:28 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:28 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:28 user nova-compute[75634]:   </cpu>
Nov 15 18:45:28 user nova-compute[75634]:   <devices>
Nov 15 18:45:28 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:45:28 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:45:28 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk"/>
Nov 15 18:45:28 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:28 user nova-compute[75634]:     </disk>
Nov 15 18:45:28 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:28 user nova-compute[75634]:       <mac address="fa:16:3e:c6:e7:27"/>
Nov 15 18:45:28 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:28 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:28 user nova-compute[75634]:       <target dev="tap7c3fa923-7e"/>
Nov 15 18:45:28 user nova-compute[75634]:     </interface>
Nov 15 18:45:28 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:28 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/console.log" append="off"/>
Nov 15 18:45:28 user nova-compute[75634]:     </serial>
Nov 15 18:45:28 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:28 user nova-compute[75634]:     <video>
Nov 15 18:45:28 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:28 user nova-compute[75634]:     </video>
Nov 15 18:45:28 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:28 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:28 user nova-compute[75634]:     </rng>
Nov 15 18:45:28 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:28 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:28 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:28 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:28 user nova-compute[75634]:   </devices>
Nov 15 18:45:28 user nova-compute[75634]: </domain>
Nov 15 18:45:28 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-111627372',display_name='tempest-TestStampPattern-server-111627372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-111627372',id=29,image_ref='459994c0-9b0f-4837-b848-1c101104180e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-qfmmy9tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e76c80e0-0538-428d-bd3c-07985d8205cc',image_min_disk='1',image_min_ram='0',image_owner_id='8eff43206fc5450ebe346f72798856f9',image_owner_project_name='tempest-TestStampPattern-326822497',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-326822497-project-member',image_user_id='d17a4320e9264810ba96eba3fcd707cf',network_allocated='True',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:25Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=2db80eba-1fb6-4671-b408-dc1acb70bc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG os_vif [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee8dd2-68f2-48bc-8c3b-6308a98a804c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa22a054-176d-534f-8058-a408263414c6', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e45ce0-c6c8-4719-bd52-814137775872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c3fa923-7e, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c3fa923-7e, col_values=(('qos', UUID('f3b30207-adad-43c2-b3fa-a104fb62e774')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c3fa923-7e, col_values=(('external_ids', {'iface-id': '7c3fa923-7e34-4a58-a565-c8214f768996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:e7:27', 'vm-uuid': '2db80eba-1fb6-4671-b408-dc1acb70bc69'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:29 user nova-compute[75634]: INFO os_vif [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e')
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec06428-d27b-40ed-bae7-b630277adee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[33063c13-c75a-45f0-8023-6ae68a663255]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:45:29 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f56de2-2dfc-421f-bef2-0b30249b7d7b]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG os_brick.utils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating existing volume attachment record: 5e75fc08-354b-496a-9f5b-1da0a23e0764 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.585s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No VIF found with MAC fa:16:3e:c6:e7:27, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updated VIF entry in instance network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28d546ba-a179-49c7-b889-feee09ffa497 req-afc5d420-93ab-4fac-944a-e4061b255a05 service nova] Releasing lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e8988672-a7d0-4098-8f85-4fc83584da4d is timed out.
Nov 15 18:45:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully detached device vdb from instance e8988672-a7d0-4098-8f85-4fc83584da4d from the live domain config.
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWNvGSdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:31 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.247589111328125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f03ca-ce1e-49fb-8e8a-1b9cf88baed6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:45:31 user nova-compute[75634]: No targets found.
Nov 15 18:45:31 user nova-compute[75634]: iSNS:
Nov 15 18:45:31 user nova-compute[75634]: No targets found.
Nov 15 18:45:31 user nova-compute[75634]: STATIC:
Nov 15 18:45:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:45:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:45:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:31 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2
Nov 15 18:45:31 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:31 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:31 user nova-compute[75634]: FIRMWARE:
Nov 15 18:45:31 user nova-compute[75634]: No targets found.
Nov 15 18:45:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:45:31 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:45:31 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033f0f6-3e74-4fcd-b467-d69cb652bfab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4cd16-90a5-4b31-b8d0-72c54a243af1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b79be0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5104b47-ae96-4374-a036-cc6a0b4b64f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] No waiting events found dispatching network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:31 user nova-compute[75634]: WARNING nova.compute.manager [req-68dc4e38-7d0b-4bc1-9156-77b5a3c05cc7 req-f4bce819-aa3f-49bb-bd1f-cde6c0128a78 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received unexpected event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 for instance with vm_state building and task_state spawning.
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a69181-0864-4499-94ad-a9d9806a8fa4]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e8988672-a7d0-4098-8f85-4fc83584da4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance aa6bb849-3c0b-4ee5-9851-853c7cad944d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c9581bab-c679-4d43-8e8b-8cc445c22060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c55eb68-e04a-4fd8-b414-6cbb4632b646]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74a736-ad00-45d5-b9f2-8c46a7baff62]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 293ff492-91e9-420a-a772-d3cc5420c905 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[247fe868-15c2-448a-a9d4-851e164163e9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2e68f-e24c-4017-be7e-9cdee55d4eae]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260]
Nov 15 18:45:31 user nova-compute[75634]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2, portal: 172.16.0.220,3260] successful.
Nov 15 18:45:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adc5a166-a8c2-4e98-aae8-2a643ca432a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1534de-aa13-4f78-a106-13806fe75b46]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== disconnect_volume: return (467ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.652s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:45:32 user nova-compute[75634]: INFO nova.compute.claims [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Claim successful on node user
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'flavor' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3ce15cb7-6505-4a07-8a54-c6eeedc9e2ae tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.497s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:45:32 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:45:32 user nova-compute[75634]: DEBUG nova.policy [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:45:32 user nova-compute[75634]: INFO nova.virt.block_device [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Booting with volume snapshot 515896df-918f-4df4-8197-bb37a1b9ec45 at /dev/vda
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] No waiting events found dispatching network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:33 user nova-compute[75634]: WARNING nova.compute.manager [req-83e98dfb-c813-4856-82f0-60e6c04819be req-e0fd8702-6304-4e81-94b6-b65732851b97 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received unexpected event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 for instance with vm_state building and task_state spawning.
Nov 15 18:45:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Instance spawned successfully.
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:33 user nova-compute[75634]: INFO nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Took 8.57 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Successfully created port: 23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:45:34 user nova-compute[75634]: INFO nova.compute.manager [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Took 9.97 seconds to build instance.
Nov 15 18:45:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-909ac9fe-a87e-44e7-b253-a2b41c06b543 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.216s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Successfully updated port: 23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-changed-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Refreshing instance network info cache due to event network-changed-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] Acquiring lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LiTYXkpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:34 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:34 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:34 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updating instance_info_cache with network_info: [{"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Instance network_info: |[{"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[31406a45-d5aa-486c-990a-b4edaaed2786]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] Acquired lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG nova.network.neutron [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Refreshing network info cache for port 23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:45:34 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e171a58-4092-45f6-aeb1-0ac8ccd24c18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b] added
Nov 15 18:45:34 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074f9e5-29a4-4175-8e29-626415da6b4b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3088f-6d06-4c4d-86d8-c8717188f9a1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LiTYXkpn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LiTYXkpn" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40d5fb-7d1d-4f97-b5fb-693566bbdf8a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LiTYXkpn'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d100c72-47d2-4d80-a5a2-19f1b4246653]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a88b2b-dcca-4454-a8c6-9fc504f0a961]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be26db2-699a-4a37-8222-fd7df9fad180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260]
Nov 15 18:45:35 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260] successful.
Nov 15 18:45:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff1b92-65bb-4936-bcc4-0802cf1683af]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6347b700-18a8-4a51-a411-bce1e2fada1e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:35 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74ad01-571c-4189-9148-5e690cbb4a34]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LiTYXkpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updated VIF entry in instance network info cache for port 23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updating instance_info_cache with network_info: [{"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d6e1904-97ca-48cd-afb9-3ea1d8128261 req-7e2cd6fe-0e5c-4490-a6ec-f7d0c64117f2 service nova] Releasing lock "refresh_cache-293ff492-91e9-420a-a772-d3cc5420c905" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23161313338323337', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161313338323337', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:45:36 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:36 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:45:36 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:36 user nova-compute[75634]:   <serial>70328014-31b5-4290-96ba-cf858edd341b</serial>
Nov 15 18:45:36 user nova-compute[75634]: </disk>
Nov 15 18:45:36 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No VIF found with MAC fa:16:3e:5c:a4:b0, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e3-24a0-4c5e-b035-0e8fe1edf493 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.989s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.utils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2a273d-064b-4b23-8003-ee89c139b4be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ddc29-87af-4831-bd04-8d1082f9401b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb863e40-a41c-46bb-b588-395228d8953d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a308e-f7fc-488c-99d0-5c15bae04ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:45:38 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:45:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1745c9df-207f-4c16-b881-52fa3910a093]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG os_brick.utils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:38 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updating existing volume attachment record: 5d4b52eb-bd8f-4b6a-97b6-fe2806aa54ca {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:39 user nova-compute[75634]: INFO nova.compute.manager [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Detaching volume 70328014-31b5-4290-96ba-cf858edd341b
Nov 15 18:45:39 user nova-compute[75634]: INFO nova.virt.block_device [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attempting to driver detach volume 70328014-31b5-4290-96ba-cf858edd341b from mountpoint /dev/vdb
Nov 15 18:45:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Attempting to detach device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:39 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:39 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:45:39 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:39 user nova-compute[75634]:   <serial>70328014-31b5-4290-96ba-cf858edd341b</serial>
Nov 15 18:45:39 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:45:39 user nova-compute[75634]: </disk>
Nov 15 18:45:39 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config.
Nov 15 18:45:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:45:39 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:39 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:45:39 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:45:39 user nova-compute[75634]:   <serial>70328014-31b5-4290-96ba-cf858edd341b</serial>
Nov 15 18:45:39 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:45:39 user nova-compute[75634]: </disk>
Nov 15 18:45:39 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:45:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:45:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing instance network info cache due to event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updated VIF entry in instance network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c7781db-6bae-4a69-ad78-a5ce19e0cacd req-a3d029c5-4d64-46b2-874c-504f3f9e5b30 service nova] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:45:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Creating image(s)
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Ensure instance console log exists: /opt/stack/data/nova/instances/293ff492-91e9-420a-a772-d3cc5420c905/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Start _get_guest_xml network_info=[{"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrvHeywC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '293ff492-91e9-420a-a772-d3cc5420c905', 'attached_at': '', 'detached_at': '', 'volume_id': '087bc9ca-1359-4a19-9487-8bd35a7c05a1', 'serial': '087bc9ca-1359-4a19-9487-8bd35a7c05a1'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '5d4b52eb-bd8f-4b6a-97b6-fe2806aa54ca', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:45:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrvHeywC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:44 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:44 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:44 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:45:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33cb5a4-f69d-4759-92b9-2c8a80254258]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:45:44 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f477d64a-d88b-4e1c-ad22-461b65a5e739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1] added
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae33ada-b188-4f51-9771-7a222c0f3e86]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86114ad0-0af3-4779-b857-703377395328]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrvHeywC {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrvHeywC" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c45c00-23e5-4af3-a5ea-042eff78a33c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrvHeywC'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6624cf94-6de8-401c-b382-728b9a831953]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd1567-a3f7-44bf-a818-11c134f9ab88]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c3add1-0413-445d-ae19-f5cda05cce61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260]
Nov 15 18:45:44 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260] successful.
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c7624f-7822-496a-ba54-3772d23cf4fd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[baea6ed0-9aa8-4918-8ced-2cd647158a59]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:44 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea680994-f637-46d5-b7aa-603649729936]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:45:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrvHeywC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26538616631646131', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538616631646131', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2075444835',display_name='tempest-TestVolumeBootPattern-server-2075444835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2075444835',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-rgr470k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:33Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=293ff492-91e9-420a-a772-d3cc5420c905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid 293ff492-91e9-420a-a772-d3cc5420c905 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:45:45 user nova-compute[75634]:   <uuid>293ff492-91e9-420a-a772-d3cc5420c905</uuid>
Nov 15 18:45:45 user nova-compute[75634]:   <name>instance-0000001e</name>
Nov 15 18:45:45 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:45:45 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:45:45 user nova-compute[75634]:   <metadata>
Nov 15 18:45:45 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:45:45 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:45:45 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-server-2075444835</nova:name>
Nov 15 18:45:45 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:45:44</nova:creationTime>
Nov 15 18:45:45 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:45:45 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:45:45 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:45:45 user nova-compute[75634]:       <nova:owner>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:45:45 user nova-compute[75634]:       </nova:owner>
Nov 15 18:45:45 user nova-compute[75634]:       <nova:ports>
Nov 15 18:45:45 user nova-compute[75634]:         <nova:port uuid="23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9">
Nov 15 18:45:45 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:45:45 user nova-compute[75634]:         </nova:port>
Nov 15 18:45:45 user nova-compute[75634]:       </nova:ports>
Nov 15 18:45:45 user nova-compute[75634]:     </nova:instance>
Nov 15 18:45:45 user nova-compute[75634]:   </metadata>
Nov 15 18:45:45 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:45:45 user nova-compute[75634]:     <system>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="serial">293ff492-91e9-420a-a772-d3cc5420c905</entry>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="uuid">293ff492-91e9-420a-a772-d3cc5420c905</entry>
Nov 15 18:45:45 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:45:45 user nova-compute[75634]:     </system>
Nov 15 18:45:45 user nova-compute[75634]:   </sysinfo>
Nov 15 18:45:45 user nova-compute[75634]:   <os>
Nov 15 18:45:45 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:45:45 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:45:45 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:45:45 user nova-compute[75634]:   </os>
Nov 15 18:45:45 user nova-compute[75634]:   <features>
Nov 15 18:45:45 user nova-compute[75634]:     <acpi/>
Nov 15 18:45:45 user nova-compute[75634]:     <apic/>
Nov 15 18:45:45 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:45:45 user nova-compute[75634]:   </features>
Nov 15 18:45:45 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:45:45 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:45:45 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:45:45 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:45:45 user nova-compute[75634]:   </clock>
Nov 15 18:45:45 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:45:45 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:45:45 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:45:45 user nova-compute[75634]:   </cpu>
Nov 15 18:45:45 user nova-compute[75634]:   <devices>
Nov 15 18:45:45 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:45:45 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:45:45 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:45:45 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:45:45 user nova-compute[75634]:       <serial>087bc9ca-1359-4a19-9487-8bd35a7c05a1</serial>
Nov 15 18:45:45 user nova-compute[75634]:     </disk>
Nov 15 18:45:45 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:45:45 user nova-compute[75634]:       <mac address="fa:16:3e:df:91:b4"/>
Nov 15 18:45:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:45 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:45:45 user nova-compute[75634]:       <target dev="tap23c57b5a-e4"/>
Nov 15 18:45:45 user nova-compute[75634]:     </interface>
Nov 15 18:45:45 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:45:45 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/293ff492-91e9-420a-a772-d3cc5420c905/console.log" append="off"/>
Nov 15 18:45:45 user nova-compute[75634]:     </serial>
Nov 15 18:45:45 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:45:45 user nova-compute[75634]:     <video>
Nov 15 18:45:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:45:45 user nova-compute[75634]:     </video>
Nov 15 18:45:45 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:45:45 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:45:45 user nova-compute[75634]:     </rng>
Nov 15 18:45:45 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:45:45 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:45:45 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:45:45 user nova-compute[75634]:     </memballoon>
Nov 15 18:45:45 user nova-compute[75634]:   </devices>
Nov 15 18:45:45 user nova-compute[75634]: </domain>
Nov 15 18:45:45 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2075444835',display_name='tempest-TestVolumeBootPattern-server-2075444835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2075444835',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-rgr470k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:33Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=293ff492-91e9-420a-a772-d3cc5420c905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG os_vif [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1449dfe-b935-5b46-800b-468767cba675', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c57b5a-e4, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23c57b5a-e4, col_values=(('qos', UUID('32abe0ef-a9df-4081-8e83-2b67af7c09ec')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23c57b5a-e4, col_values=(('external_ids', {'iface-id': '23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:91:b4', 'vm-uuid': '293ff492-91e9-420a-a772-d3cc5420c905'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:45 user nova-compute[75634]: INFO os_vif [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4')
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:45:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:df:91:b4, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:46 user nova-compute[75634]: INFO nova.compute.manager [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Shelving
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:46 user nova-compute[75634]: WARNING nova.compute.manager [req-eba1495e-dcbc-46c6-beb2-c7493f959118 req-5011a76d-3231-4408-a9fa-8f9315927f1c service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state active and task_state shelving.
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] No waiting events found dispatching network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:47 user nova-compute[75634]: WARNING nova.compute.manager [req-f6e82015-2789-4580-933f-34b63589889d req-367b481c-b912-42d8-957c-f1beaad4a152 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received unexpected event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 for instance with vm_state building and task_state spawning.
Nov 15 18:45:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance destroyed successfully.
Nov 15 18:45:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Beginning cold snapshot process
Nov 15 18:45:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:45:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk /opt/stack/data/nova/instances/snapshots/tmpaz2het7j/0f4446595deb4561b0f408c2de8aa40b {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:48 user nova-compute[75634]: WARNING nova.compute.manager [req-2c489b2b-7b81-46e9-8d95-54a3a5962906 req-06bd0dc0-291b-4de5-becd-b547fb9ffe83 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 18:45:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk /opt/stack/data/nova/instances/snapshots/tmpaz2het7j/0f4446595deb4561b0f408c2de8aa40b" returned: 0 in 0.924s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Snapshot extracted, beginning image upload
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] No waiting events found dispatching network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:45:49 user nova-compute[75634]: WARNING nova.compute.manager [req-5e5d3035-c952-4026-9f8b-be7ba394b01c req-4f6f8d76-d0f8-48d3-80a2-5fd35a06bead service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received unexpected event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 for instance with vm_state building and task_state spawning.
Nov 15 18:45:49 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa6bb849-3c0b-4ee5-9851-853c7cad944d is timed out.
Nov 15 18:45:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance aa6bb849-3c0b-4ee5-9851-853c7cad944d from the live domain config.
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGtLlcbw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:49 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[87475a18-3754-436e-ab3e-426b8faeccb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:45:49 user nova-compute[75634]: No targets found.
Nov 15 18:45:49 user nova-compute[75634]: iSNS:
Nov 15 18:45:49 user nova-compute[75634]: No targets found.
Nov 15 18:45:49 user nova-compute[75634]: STATIC:
Nov 15 18:45:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b
Nov 15 18:45:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:45:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1
Nov 15 18:45:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0
Nov 15 18:45:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:49 user nova-compute[75634]: FIRMWARE:
Nov 15 18:45:49 user nova-compute[75634]: No targets found.
Nov 15 18:45:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:45:49 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:45:49 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc610df3-d9f4-4e21-80c0-f2920d0559da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c026e6-ce86-42aa-9f21-e5fb19353263]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:49 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b445908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0'): ({'sdh'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Removing single pathed devices sdh {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53e854-c660-4397-a53b-009c5136eaec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b371edac-4cbf-412d-89a1-26415372171a]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flushing IO for device /dev/sdh {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b0ed2-46a6-4e6b-9c82-23479fed31eb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[34591c26-b98e-4f4e-8b5e-dbd8bf3fe72c]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12300f2-3365-4908-b194-64acbfb7b95e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d3577-b49d-42d0-ad9e-edca68e41493]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260]
Nov 15 18:45:49 user nova-compute[75634]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0, portal: 172.16.0.220,3260] successful.
Nov 15 18:45:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d4860c-b031-4cca-8210-4dad1ac07ab0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e7a35-4c1a-4627-b526-bad1c2287843]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== disconnect_volume: return (360ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:45:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Instance spawned successfully.
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:45:50 user nova-compute[75634]: INFO nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 15 18:45:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:50 user nova-compute[75634]: INFO nova.compute.manager [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Took 18.59 seconds to build instance.
Nov 15 18:45:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d3e3ca26-35a5-4ee4-be95-a5a690ee2ae9 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.734s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b1445bb7-34fa-4e16-ba26-8e1e40f589aa tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.661s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Snapshot image upload complete
Nov 15 18:45:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:51 user nova-compute[75634]: INFO nova.compute.manager [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Shelve offloading
Nov 15 18:45:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance destroyed successfully.
Nov 15 18:45:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:45:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:51 user nova-compute[75634]: DEBUG nova.network.neutron [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.network.neutron [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance destroyed successfully.
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.objects.instance [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'resources' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDceSRZZYYGJAolOqq+Csa4e5/GlQE0ZUR3RKnZpRDfgvkR68Q6PJk82SbxBJYVuhYJRoZ4hP7JdRVYP9HSe31IA6Hk461NvXTGdxoEdeZxPmRd7RFCbzIMtSKNpJrt+sA==',key_name='tempest-keypair-1393165220',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:45:51.690612',shelved_host='user',shelved_image_id='3079493f-18e4-4292-b5ea-3519cbed1c17'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:45:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG os_vif [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef57442-7b, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b67cf492-8dc1-4f0f-a160-223e632a071a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing instance network info cache due to event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:52 user nova-compute[75634]: INFO os_vif [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b')
Nov 15 18:45:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Deleting instance files /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060_del
Nov 15 18:45:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Deletion of /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060_del complete
Nov 15 18:45:52 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Deleted allocations for instance c9581bab-c679-4d43-8e8b-8cc445c22060
Nov 15 18:45:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.objects.instance [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'numa_topology' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:45:52 user nova-compute[75634]: DEBUG nova.objects.base [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<c9581bab-c679-4d43-8e8b-8cc445c22060> lazy-loaded attributes: resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updated VIF entry in instance network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG nova.network.neutron [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbef57442-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3c3785c9-fbbf-4453-b6ae-15979d123c0d req-0c7e16a8-2915-4212-a897-9875df939cdc service nova] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-867bc57c-94f8-4137-a63e-262c65a72ed6 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.424s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:45:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:45:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f is timed out.
Nov 15 18:45:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config.
Nov 15 18:45:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LiTYXkpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:45:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9826e4d-2a19-45e3-9a8a-d662b0f1d9ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:45:59 user nova-compute[75634]: No targets found.
Nov 15 18:45:59 user nova-compute[75634]: iSNS:
Nov 15 18:45:59 user nova-compute[75634]: No targets found.
Nov 15 18:45:59 user nova-compute[75634]: STATIC:
Nov 15 18:45:59 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b
Nov 15 18:45:59 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:59 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:59 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:45:59 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:59 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:59 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1
Nov 15 18:45:59 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:45:59 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:45:59 user nova-compute[75634]: FIRMWARE:
Nov 15 18:45:59 user nova-compute[75634]: No targets found.
Nov 15 18:45:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:45:59 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:45:59 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94d080-4ffd-44a2-b213-52c37bb1cb45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac01c7-ce05-4f7b-ab14-282a5f529bf1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:59 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:59 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:45:59 user nova-compute[75634]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b (non-flash)
Nov 15 18:45:59 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:45:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b685df490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba84626-e826-439a-a9f3-4f26b19c29b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70b0aa2-e074-426e-8db3-625e275b2277]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7415dec-a87b-44e2-a2ae-0e9cf3a71650]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:45:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c08135-cd81-4f8d-95dd-e474b0fbb274]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9568702-cdc5-4776-b56e-d84a5886af2d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b5e040-1a0e-4e11-a2ff-f557c9a9e55c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260]
Nov 15 18:46:00 user nova-compute[75634]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b, portal: 172.16.0.220,3260] successful.
Nov 15 18:46:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70328014-31b5-4290-96ba-cf858edd341b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b5a665-6022-41cc-a70a-8b51275d232d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== disconnect_volume: return (341ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:00 user nova-compute[75634]: INFO nova.compute.manager [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Terminating instance
Nov 15 18:46:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-e09d3701-66c6-4fd7-b3d6-a1b84b9f1f5c req-2b48b9de-8b88-48dc-81a0-872fe3c1046d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-unplugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7e86f634-da7a-4ab6-b9b5-2879ea39f305 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Instance destroyed successfully.
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'resources' on Instance uuid e8988672-a7d0-4098-8f85-4fc83584da4d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2035561163',display_name='tempest-ServerActionsTestOtherA-server-470214741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2035561163',id=15,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqLYytXpcRmqR+DFWS0/j3BPJQEsVmROjPbCgTa4WILYhtNM+fcEQwzPwkHbzDz3ucfSDbmtWG7Q+cRDInswheWmFp4yNPzFA1ifLFz39AckVkkvEbuyc0RUkSNuYkqwg==',key_name='tempest-keypair-1069987129',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-hc405mrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=e8988672-a7d0-4098-8f85-4fc83584da4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "address": "fa:16:3e:95:33:70", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0727a542-fa", "ovs_interfaceid": "0727a542-fa46-4bf2-8a73-49aa02c2547d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG os_vif [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0727a542-fa, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b1c3179-bf24-40aa-bf80-474cce3fb76b) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:01 user nova-compute[75634]: INFO os_vif [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:33:70,bridge_name='br-int',has_traffic_filtering=True,id=0727a542-fa46-4bf2-8a73-49aa02c2547d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0727a542-fa')
Nov 15 18:46:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Deleting instance files /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d_del
Nov 15 18:46:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Deletion of /opt/stack/data/nova/instances/e8988672-a7d0-4098-8f85-4fc83584da4d_del complete
Nov 15 18:46:01 user nova-compute[75634]: INFO nova.compute.manager [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 18:46:01 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:46:01 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:02 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Took 0.78 seconds to deallocate network for instance.
Nov 15 18:46:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-c729d082-a441-4603-99a4-a0f030f4b2a8 req-9d961ed9-c676-4118-bdce-7412667e9c57 service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-deleted-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:46:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:02 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Deleted allocations for instance e8988672-a7d0-4098-8f85-4fc83584da4d
Nov 15 18:46:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4e2e3a1d-3b8f-4cff-9a12-74b60ff9eb2b tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.364s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] Acquiring lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] Lock "e8988672-a7d0-4098-8f85-4fc83584da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] No waiting events found dispatching network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:03 user nova-compute[75634]: WARNING nova.compute.manager [req-244f7156-3273-419b-bd2b-7cfe22400f27 req-c6be02df-e988-4e6a-aeb8-d1dab0cea10d service nova] [instance: e8988672-a7d0-4098-8f85-4fc83584da4d] Received unexpected event network-vif-plugged-0727a542-fa46-4bf2-8a73-49aa02c2547d for instance with vm_state deleted and task_state None.
Nov 15 18:46:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:18 user nova-compute[75634]: INFO nova.compute.manager [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Terminating instance
Nov 15 18:46:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-unplugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] No waiting events found dispatching network-vif-unplugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-893283e0-1f3a-493a-8e23-5d1d96184287 req-869679d2-849f-4627-aa66-1ebc779aaaeb service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-unplugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:46:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Instance destroyed successfully.
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'resources' on Instance uuid aa6bb849-3c0b-4ee5-9851-853c7cad944d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-169176126',display_name='tempest-AttachVolumeNegativeTest-server-169176126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-169176126',id=17,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMl1F1yspa1UYMxHa9lLNdrJcbrHV+0U2acjaTiKKobscfXbr+cQ2hrO/wNQJMTUwNjrgHDb6t/CqpiqYNo3iorDa9u06psfKa9WRgF7UGow460BtPWtKCfIKYPodNqPA==',key_name='tempest-keypair-1946616824',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-3t40jsv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=aa6bb849-3c0b-4ee5-9851-853c7cad944d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "address": "fa:16:3e:4a:7b:21", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a67beff-cb", "ovs_interfaceid": "8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG os_vif [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a67beff-cb, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f50b0627-959d-4599-a08a-f98e6baa7328) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:19 user nova-compute[75634]: INFO os_vif [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7b:21,bridge_name='br-int',has_traffic_filtering=True,id=8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a67beff-cb')
Nov 15 18:46:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Deleting instance files /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d_del
Nov 15 18:46:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Deletion of /opt/stack/data/nova/instances/aa6bb849-3c0b-4ee5-9851-853c7cad944d_del complete
Nov 15 18:46:19 user nova-compute[75634]: INFO nova.compute.manager [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 15 18:46:19 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:46:19 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:46:20 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:20 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Took 0.86 seconds to deallocate network for instance.
Nov 15 18:46:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-b16e8140-7dee-4802-9140-e027597aefe9 req-71a4a403-0ef4-472e-8d36-9a960b47a8fe service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-deleted-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] Acquiring lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] No waiting events found dispatching network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:21 user nova-compute[75634]: WARNING nova.compute.manager [req-325ce7aa-8f9c-4d8f-a7e0-8414726c65b2 req-6c13ae63-6b89-4a4e-942f-bff633fbfdd5 service nova] [instance: aa6bb849-3c0b-4ee5-9851-853c7cad944d] Received unexpected event network-vif-plugged-8a67beff-cb81-4ea4-acfc-7b7a2a6ee0d0 for instance with vm_state deleted and task_state None.
Nov 15 18:46:21 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:21 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Deleted allocations for instance aa6bb849-3c0b-4ee5-9851-853c7cad944d
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bacebdcb-3075-4505-bfa1-f7d3a2a05f3a tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "aa6bb849-3c0b-4ee5-9851-853c7cad944d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:21 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:46:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=25.08858871459961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 293ff492-91e9-420a-a772-d3cc5420c905 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:46:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:46:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:32 user nova-compute[75634]: INFO nova.compute.manager [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attaching volume 854900e1-a21c-4fed-a63e-28b59ce37655 to /dev/vdb
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.utils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e0d1b8-722d-4da3-80e0-2c3826763b0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d6a8f-939e-44fd-9a30-2677aff19d20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[16375f87-56fc-4601-aa09-4e9482b19b47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e84b5b-81b1-4548-9a9d-f45a1f3507c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:46:32 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:46:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc13432-aa33-45e2-9f88-87cb36ee0093]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG os_brick.utils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:46:32 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating existing volume attachment record: 277c10cf-5cf9-420b-9088-63cc2f808514 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:46:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPtDKoIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:46:37 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:46:37 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:46:37 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2f445-e1e4-45fc-aefe-c1105add8757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:46:37 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f5f08-eb93-47dc-af99-5298207bcbf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655] added
Nov 15 18:46:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8f2dca-e1da-485b-b83f-261020bab0bf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b22ba8-5dc9-4e9b-82d3-80ee138757a3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPtDKoIn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPtDKoIn" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8898ee-74f6-4794-89e2-26e678ae324d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MPtDKoIn'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5aac3c-ec97-40e5-800d-cb5f3c14dc3f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7d066-ab03-4d29-a003-664dd71fa9e0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc94c3-0414-4419-be2b-87f39e77c95c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260]
Nov 15 18:46:38 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260] successful.
Nov 15 18:46:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[05379c03-9522-4191-bf81-163f1c6c4c94]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a404953-a998-4076-b1a5-449f52a51a2f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:46:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24902fe4-4ae1-4768-856d-ad68134e11b2]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:46:38 user nova-compute[75634]: INFO nova.compute.manager [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Rescuing
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:46:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPtDKoIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23530646561393337', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530646561393337', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:46:39 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:46:39 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:46:39 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:46:39 user nova-compute[75634]:   <serial>854900e1-a21c-4fed-a63e-28b59ce37655</serial>
Nov 15 18:46:39 user nova-compute[75634]: </disk>
Nov 15 18:46:39 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No VIF found with MAC fa:16:3e:5c:a4:b0, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7326dc07-21b6-4c01-9cee-e16d6b7a876d tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.143s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance destroyed successfully.
Nov 15 18:46:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Attempting a stable device rescue
Nov 15 18:46:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:46:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Creating image(s)
Nov 15 18:46:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.virt.images [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] 07ffaaca-c705-4734-ad0e-5eba85605c3b was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.part /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:42 user nova-compute[75634]: INFO nova.compute.manager [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Detaching volume 854900e1-a21c-4fed-a63e-28b59ce37655
Nov 15 18:46:42 user nova-compute[75634]: INFO nova.virt.block_device [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attempting to driver detach volume 854900e1-a21c-4fed-a63e-28b59ce37655 from mountpoint /dev/vdb
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Attempting to detach device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:46:42 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:46:42 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:46:42 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:46:42 user nova-compute[75634]:   <serial>854900e1-a21c-4fed-a63e-28b59ce37655</serial>
Nov 15 18:46:42 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:46:42 user nova-compute[75634]: </disk>
Nov 15 18:46:42 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:46:42 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config.
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:46:42 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:46:42 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:46:42 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:46:42 user nova-compute[75634]:   <serial>854900e1-a21c-4fed-a63e-28b59ce37655</serial>
Nov 15 18:46:42 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:46:42 user nova-compute[75634]: </disk>
Nov 15 18:46:42 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.part /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.converted" returned: 0 in 0.592s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.320s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea,backing_fmt=raw /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea,backing_fmt=raw /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue" returned: 0 in 0.055s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "82be5b3b0fdcca2997ac3636ace1acdc572305ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'migration_context' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<0ecd19a3-6712-411c-94fe-bdc95fc2b28c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start _get_guest_xml network_info=[{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:05:c3:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '07ffaaca-c705-4734-ad0e-5eba85605c3b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0ecd19a3-6712-411c-94fe-bdc95fc2b28c', 'attached_at': '', 'detached_at': '', 'volume_id': '6ab816fd-fb1d-4a4a-b41f-86983a223358', 'serial': '6ab816fd-fb1d-4a4a-b41f-86983a223358'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '7b9e3f11-571a-4ccf-ad1f-85865f662b62', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<0ecd19a3-6712-411c-94fe-bdc95fc2b28c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<0ecd19a3-6712-411c-94fe-bdc95fc2b28c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<0ecd19a3-6712-411c-94fe-bdc95fc2b28c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:46:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:46:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:46:43 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[36989813-63de-4a70-825c-26d929a80206]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BrLnmHVl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 18:46:43 user nova-compute[75634]: node.name = iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:46:43 user nova-compute[75634]: node.tpgt = -1
Nov 15 18:46:43 user nova-compute[75634]: node.startup = automatic
Nov 15 18:46:43 user nova-compute[75634]: node.leading_login = No
Nov 15 18:46:43 user nova-compute[75634]: iface.iscsi_ifacename = default
Nov 15 18:46:43 user nova-compute[75634]: iface.net_ifacename = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.ipaddress = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.prefix_len = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.hwaddress = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.transport_name = tcp
Nov 15 18:46:43 user nova-compute[75634]: iface.initiatorname = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.vlan_id = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.vlan_priority = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.vlan_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.iface_num = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.mtu = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.port = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.bootproto = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.subnet_mask = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.gateway = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_alt_client_id = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_dns = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_learn_iqn = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_vendor_id_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_vendor_id = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.dhcp_slp_da = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.fragmentation = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.gratuitous_arp = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.incoming_forwarding = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.tos_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.tos = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.ttl = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.delayed_ack = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.tcp_nagle = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.tcp_wsf_state = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.tcp_wsf = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.tcp_timer_scale = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.tcp_timestamp = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.redirect = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.def_task_mgmt_timeout = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.header_digest = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.data_digest = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.immediate_data = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.initial_r2t = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.data_seq_inorder = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.data_pdu_inorder = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.erl = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.max_receive_data_len = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.first_burst_len = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.max_outstanding_r2t = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.max_burst_len = 0
Nov 15 18:46:43 user nova-compute[75634]: iface.chap_auth = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.bidi_chap = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.strict_login_compliance = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.discovery_auth = <empty>
Nov 15 18:46:43 user nova-compute[75634]: iface.discovery_logout = <empty>
Nov 15 18:46:43 user nova-compute[75634]: node.discovery_address = <empty>
Nov 15 18:46:43 user nova-compute[75634]: node.discovery_port = 0
Nov 15 18:46:43 user nova-compute[75634]: node.discovery_type = static
Nov 15 18:46:43 user nova-compute[75634]: node.session.initial_cmdsn = 0
Nov 15 18:46:43 user nova-compute[75634]: node.session.initial_login_retry_max = 8
Nov 15 18:46:43 user nova-compute[75634]: node.session.xmit_thread_priority = -20
Nov 15 18:46:43 user nova-compute[75634]: node.session.cmds_max = 128
Nov 15 18:46:43 user nova-compute[75634]: node.session.queue_depth = 32
Nov 15 18:46:43 user nova-compute[75634]: node.session.nr_sessions = 1
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.authmethod = CHAP
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.username = BrLnmHVl
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.password = ***
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.username_in = <empty>
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.password_in = <empty>
Nov 15 18:46:43 user nova-compute[75634]: node.session.auth.chap_algs = MD5
Nov 15 18:46:43 user nova-compute[75634]: node.session.timeo.replacement_timeout = 120
Nov 15 18:46:43 user nova-compute[75634]: node.session.err_timeo.abort_timeout = 15
Nov 15 18:46:43 user nova-compute[75634]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 18:46:43 user nova-compute[75634]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 18:46:43 user nova-compute[75634]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.FastAbort = Yes
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.InitialR2T = No
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.ImmediateData = Yes
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.MaxConnections = 1
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 18:46:43 user nova-compute[75634]: node.session.iscsi.ERL = 0
Nov 15 18:46:43 user nova-compute[75634]: node.session.scan = manual
Nov 15 18:46:43 user nova-compute[75634]: node.session.reopen_max = 0
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].address = 172.16.0.220
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].port = 3260
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].startup = manual
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].tcp.window_size = 524288
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].tcp.type_of_service = 0
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].timeo.logout_timeout = 15
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].timeo.login_timeout = 15
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].timeo.auth_timeout = 45
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.DataDigest = None
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.IFMarker = No
Nov 15 18:46:43 user nova-compute[75634]: node.conn[0].iscsi.OFMarker = No
Nov 15 18:46:43 user nova-compute[75634]: # END RECORD
Nov 15 18:46:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce10a9f-2d2f-4c1c-883a-18dc617cf73f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b5828a-426f-4ed8-9f49-747b7ff179aa]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrLnmHVl {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrLnmHVl" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a558a1ce-390c-49de-a732-b28359ca3b5b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrLnmHVl'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e412352-fa1b-4ab7-a810-575a3cac1586]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1d4c48-4360-4a1c-b260-cc15e98ad9b9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:46:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2fcc9-3d25-4af2-9908-5f5e66d2ef07]: (4, ('0 0 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23036326663653337', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036326663653337', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1145365935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1145365935',id=25,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-elq2iktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:05Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=0ecd19a3-6712-411c-94fe-bdc95fc2b28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:05:c3:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:05:c3:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<0ecd19a3-6712-411c-94fe-bdc95fc2b28c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:46:43 user nova-compute[75634]:   <uuid>0ecd19a3-6712-411c-94fe-bdc95fc2b28c</uuid>
Nov 15 18:46:43 user nova-compute[75634]:   <name>instance-00000019</name>
Nov 15 18:46:43 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:46:43 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:46:43 user nova-compute[75634]:   <metadata>
Nov 15 18:46:43 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:46:43 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1145365935</nova:name>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:46:43</nova:creationTime>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:46:43 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:46:43 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:owner>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:46:43 user nova-compute[75634]:       </nova:owner>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:46:43 user nova-compute[75634]:       <nova:ports>
Nov 15 18:46:43 user nova-compute[75634]:         <nova:port uuid="cb2f6f12-998b-4f5b-9e86-d068d4dedd31">
Nov 15 18:46:43 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:46:43 user nova-compute[75634]:         </nova:port>
Nov 15 18:46:43 user nova-compute[75634]:       </nova:ports>
Nov 15 18:46:43 user nova-compute[75634]:     </nova:instance>
Nov 15 18:46:43 user nova-compute[75634]:   </metadata>
Nov 15 18:46:43 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:46:43 user nova-compute[75634]:     <system>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="serial">0ecd19a3-6712-411c-94fe-bdc95fc2b28c</entry>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="uuid">0ecd19a3-6712-411c-94fe-bdc95fc2b28c</entry>
Nov 15 18:46:43 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:46:43 user nova-compute[75634]:     </system>
Nov 15 18:46:43 user nova-compute[75634]:   </sysinfo>
Nov 15 18:46:43 user nova-compute[75634]:   <os>
Nov 15 18:46:43 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:46:43 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:46:43 user nova-compute[75634]:   </os>
Nov 15 18:46:43 user nova-compute[75634]:   <features>
Nov 15 18:46:43 user nova-compute[75634]:     <acpi/>
Nov 15 18:46:43 user nova-compute[75634]:     <apic/>
Nov 15 18:46:43 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:46:43 user nova-compute[75634]:   </features>
Nov 15 18:46:43 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:46:43 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:46:43 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:46:43 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:46:43 user nova-compute[75634]:   </clock>
Nov 15 18:46:43 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:46:43 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:46:43 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:46:43 user nova-compute[75634]:   </cpu>
Nov 15 18:46:43 user nova-compute[75634]:   <devices>
Nov 15 18:46:43 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:46:43 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:46:43 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 18:46:43 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:46:43 user nova-compute[75634]:       <serial>6ab816fd-fb1d-4a4a-b41f-86983a223358</serial>
Nov 15 18:46:43 user nova-compute[75634]:     </disk>
Nov 15 18:46:43 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:46:43 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:46:43 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue"/>
Nov 15 18:46:43 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:46:43 user nova-compute[75634]:       <boot order="1"/>
Nov 15 18:46:43 user nova-compute[75634]:     </disk>
Nov 15 18:46:43 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:46:43 user nova-compute[75634]:       <mac address="fa:16:3e:05:c3:10"/>
Nov 15 18:46:43 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:43 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:46:43 user nova-compute[75634]:       <target dev="tapcb2f6f12-99"/>
Nov 15 18:46:43 user nova-compute[75634]:     </interface>
Nov 15 18:46:43 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:46:43 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/console.log" append="off"/>
Nov 15 18:46:43 user nova-compute[75634]:     </serial>
Nov 15 18:46:43 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:46:43 user nova-compute[75634]:     <video>
Nov 15 18:46:43 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:43 user nova-compute[75634]:     </video>
Nov 15 18:46:43 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:46:43 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:46:43 user nova-compute[75634]:     </rng>
Nov 15 18:46:43 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:46:43 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:46:43 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:46:43 user nova-compute[75634]:     </memballoon>
Nov 15 18:46:43 user nova-compute[75634]:   </devices>
Nov 15 18:46:43 user nova-compute[75634]: </domain>
Nov 15 18:46:43 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:46:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance destroyed successfully.
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:05:c3:10, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:46:44 user nova-compute[75634]: INFO nova.compute.claims [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Claim successful on node user
Nov 15 18:46:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:46:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:46:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.policy [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfa5c40718134a13a514c8a165b42ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247be554293e4d36a923272a63270742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:46:45 user nova-compute[75634]: INFO nova.compute.claims [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Claim successful on node user
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:46:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Creating image(s)
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.virt.images [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] 6f1e808b-e222-4001-924b-60dcfac9da06 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.part /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Successfully created port: 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.part /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.converted" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.113s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.220s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:46 user nova-compute[75634]: WARNING nova.compute.manager [req-abbe2f00-2849-435a-94c2-6ac1c2adbdc6 req-9a0d8960-34a5-4a95-beca-26bebcbefbbe service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state active and task_state rescuing.
Nov 15 18:46:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.policy [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bb679f2e1c44f8eae59835d407bb39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d234e65d9a4542b82a6d9bb0545523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:46:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Creating image(s)
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "/opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "/opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "/opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac,backing_fmt=raw /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac,backing_fmt=raw /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk 1073741824" returned: 0 in 0.056s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "62bbec68958a70b3232e74818c605cfd01a5d5ac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:46:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk 1073741824" returned: 0 in 0.057s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Successfully updated port: 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Cannot resize image /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Ensure instance console log exists: /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Successfully created port: 48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Cannot resize image /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Ensure instance console log exists: /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance network_info: |[{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start _get_guest_xml network_info=[{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:46:41Z,direct_url=<?>,disk_format='qcow2',id=6f1e808b-e222-4001-924b-60dcfac9da06,min_disk=0,min_ram=0,name='tempest-scenario-img--1669940503',owner='247be554293e4d36a923272a63270742',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '6f1e808b-e222-4001-924b-60dcfac9da06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:46:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:46:41Z,direct_url=<?>,disk_format='qcow2',id=6f1e808b-e222-4001-924b-60dcfac9da06,min_disk=0,min_ram=0,name='tempest-scenario-img--1669940503',owner='247be554293e4d36a923272a63270742',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:46:45Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'pci_devices' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:46:47 user nova-compute[75634]:   <uuid>f89d2edf-0b80-484f-9176-76a0bf07d6d4</uuid>
Nov 15 18:46:47 user nova-compute[75634]:   <name>instance-0000001f</name>
Nov 15 18:46:47 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:46:47 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:46:47 user nova-compute[75634]:   <metadata>
Nov 15 18:46:47 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:46:47 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:name>tempest-TestMinimumBasicScenario-server-1410239741</nova:name>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:46:47</nova:creationTime>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:46:47 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:46:47 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:owner>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:user uuid="cfa5c40718134a13a514c8a165b42ab3">tempest-TestMinimumBasicScenario-547369327-project-member</nova:user>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:project uuid="247be554293e4d36a923272a63270742">tempest-TestMinimumBasicScenario-547369327</nova:project>
Nov 15 18:46:47 user nova-compute[75634]:       </nova:owner>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:root type="image" uuid="6f1e808b-e222-4001-924b-60dcfac9da06"/>
Nov 15 18:46:47 user nova-compute[75634]:       <nova:ports>
Nov 15 18:46:47 user nova-compute[75634]:         <nova:port uuid="4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed">
Nov 15 18:46:47 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:46:47 user nova-compute[75634]:         </nova:port>
Nov 15 18:46:47 user nova-compute[75634]:       </nova:ports>
Nov 15 18:46:47 user nova-compute[75634]:     </nova:instance>
Nov 15 18:46:47 user nova-compute[75634]:   </metadata>
Nov 15 18:46:47 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:46:47 user nova-compute[75634]:     <system>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="serial">f89d2edf-0b80-484f-9176-76a0bf07d6d4</entry>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="uuid">f89d2edf-0b80-484f-9176-76a0bf07d6d4</entry>
Nov 15 18:46:47 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:46:47 user nova-compute[75634]:     </system>
Nov 15 18:46:47 user nova-compute[75634]:   </sysinfo>
Nov 15 18:46:47 user nova-compute[75634]:   <os>
Nov 15 18:46:47 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:46:47 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:46:47 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:46:47 user nova-compute[75634]:   </os>
Nov 15 18:46:47 user nova-compute[75634]:   <features>
Nov 15 18:46:47 user nova-compute[75634]:     <acpi/>
Nov 15 18:46:47 user nova-compute[75634]:     <apic/>
Nov 15 18:46:47 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:46:47 user nova-compute[75634]:   </features>
Nov 15 18:46:47 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:46:47 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:46:47 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:46:47 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:46:47 user nova-compute[75634]:   </clock>
Nov 15 18:46:47 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:46:47 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:46:47 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:46:47 user nova-compute[75634]:   </cpu>
Nov 15 18:46:47 user nova-compute[75634]:   <devices>
Nov 15 18:46:47 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:46:47 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:46:47 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk"/>
Nov 15 18:46:47 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:46:47 user nova-compute[75634]:     </disk>
Nov 15 18:46:47 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:46:47 user nova-compute[75634]:       <mac address="fa:16:3e:ad:30:fe"/>
Nov 15 18:46:47 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:47 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:46:47 user nova-compute[75634]:       <target dev="tap4dbbb306-50"/>
Nov 15 18:46:47 user nova-compute[75634]:     </interface>
Nov 15 18:46:47 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:46:47 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/console.log" append="off"/>
Nov 15 18:46:47 user nova-compute[75634]:     </serial>
Nov 15 18:46:47 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:46:47 user nova-compute[75634]:     <video>
Nov 15 18:46:47 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:47 user nova-compute[75634]:     </video>
Nov 15 18:46:47 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:46:47 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:46:47 user nova-compute[75634]:     </rng>
Nov 15 18:46:47 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:46:47 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:46:47 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:46:47 user nova-compute[75634]:     </memballoon>
Nov 15 18:46:47 user nova-compute[75634]:   </devices>
Nov 15 18:46:47 user nova-compute[75634]: </domain>
Nov 15 18:46:47 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:46:45Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG os_vif [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ceac5e-c71c-599b-ad35-cea80740b7a1', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-4f4acf1f-f155-4fc5-aca3-4aa42c95e1a5 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dbbb306-50, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dbbb306-50, col_values=(('qos', UUID('416ec50f-e665-47bf-b68b-42eacf583828')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dbbb306-50, col_values=(('external_ids', {'iface-id': '4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:30:fe', 'vm-uuid': 'f89d2edf-0b80-484f-9176-76a0bf07d6d4'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:47 user nova-compute[75634]: INFO os_vif [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50')
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No VIF found with MAC fa:16:3e:ad:30:fe, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Successfully updated port: 48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquired lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-changed-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Refreshing instance network info cache due to event network-changed-48640e4b-6a0a-4533-a947-5f9f89d26f1d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] Acquiring lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating instance_info_cache with network_info: [{"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Releasing lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Instance network_info: |[{"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] Acquired lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Refreshing network info cache for port 48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Start _get_guest_xml network_info=[{"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:46:48 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:48 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2001652328',display_name='tempest-TestServerVolumeAttachmentScenario-server-2001652328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2001652328',id=32,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl60T3DlaUczJk2Zwoi3h9SM0ss/Q6+kUDXX1NLEIXhXMEccyD8ZK9VbqGu/P6Wn3FTrUxp/GAIoUHNmFLGUkd4JL1gR5yKh7iauBsgsUBfMMBYJwHXVDSV8PwpyMjTEg==',key_name='tempest-keypair-406405799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d234e65d9a4542b82a6d9bb0545523',ramdisk_id='',reservation_id='r-19drwqhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1721559897',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1721559897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bb679f2e1c44f8eae59835d407bb39b',uuid=615fab46-3173-4f68-b938-c88142b8836a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converting VIF {"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'pci_devices' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:48 user nova-compute[75634]: WARNING nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state None.
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:48 user nova-compute[75634]: WARNING nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state None.
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing instance network info cache due to event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:46:48 user nova-compute[75634]:   <uuid>615fab46-3173-4f68-b938-c88142b8836a</uuid>
Nov 15 18:46:48 user nova-compute[75634]:   <name>instance-00000020</name>
Nov 15 18:46:48 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:46:48 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:46:48 user nova-compute[75634]:   <metadata>
Nov 15 18:46:48 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:46:48 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2001652328</nova:name>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:46:48</nova:creationTime>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:46:48 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:46:48 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:owner>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:user uuid="6bb679f2e1c44f8eae59835d407bb39b">tempest-TestServerVolumeAttachmentScenario-1721559897-project-member</nova:user>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:project uuid="b2d234e65d9a4542b82a6d9bb0545523">tempest-TestServerVolumeAttachmentScenario-1721559897</nova:project>
Nov 15 18:46:48 user nova-compute[75634]:       </nova:owner>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:46:48 user nova-compute[75634]:       <nova:ports>
Nov 15 18:46:48 user nova-compute[75634]:         <nova:port uuid="48640e4b-6a0a-4533-a947-5f9f89d26f1d">
Nov 15 18:46:48 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:46:48 user nova-compute[75634]:         </nova:port>
Nov 15 18:46:48 user nova-compute[75634]:       </nova:ports>
Nov 15 18:46:48 user nova-compute[75634]:     </nova:instance>
Nov 15 18:46:48 user nova-compute[75634]:   </metadata>
Nov 15 18:46:48 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:46:48 user nova-compute[75634]:     <system>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="serial">615fab46-3173-4f68-b938-c88142b8836a</entry>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="uuid">615fab46-3173-4f68-b938-c88142b8836a</entry>
Nov 15 18:46:48 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:46:48 user nova-compute[75634]:     </system>
Nov 15 18:46:48 user nova-compute[75634]:   </sysinfo>
Nov 15 18:46:48 user nova-compute[75634]:   <os>
Nov 15 18:46:48 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:46:48 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:46:48 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:46:48 user nova-compute[75634]:   </os>
Nov 15 18:46:48 user nova-compute[75634]:   <features>
Nov 15 18:46:48 user nova-compute[75634]:     <acpi/>
Nov 15 18:46:48 user nova-compute[75634]:     <apic/>
Nov 15 18:46:48 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:46:48 user nova-compute[75634]:   </features>
Nov 15 18:46:48 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:46:48 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:46:48 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:46:48 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:46:48 user nova-compute[75634]:   </clock>
Nov 15 18:46:48 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:46:48 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:46:48 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:46:48 user nova-compute[75634]:   </cpu>
Nov 15 18:46:48 user nova-compute[75634]:   <devices>
Nov 15 18:46:48 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:46:48 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:46:48 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk"/>
Nov 15 18:46:48 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:46:48 user nova-compute[75634]:     </disk>
Nov 15 18:46:48 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:46:48 user nova-compute[75634]:       <mac address="fa:16:3e:7d:22:e6"/>
Nov 15 18:46:48 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:48 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:46:48 user nova-compute[75634]:       <target dev="tap48640e4b-6a"/>
Nov 15 18:46:48 user nova-compute[75634]:     </interface>
Nov 15 18:46:48 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:46:48 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/console.log" append="off"/>
Nov 15 18:46:48 user nova-compute[75634]:     </serial>
Nov 15 18:46:48 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:46:48 user nova-compute[75634]:     <video>
Nov 15 18:46:48 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:48 user nova-compute[75634]:     </video>
Nov 15 18:46:48 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:46:48 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:46:48 user nova-compute[75634]:     </rng>
Nov 15 18:46:48 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:46:48 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:46:48 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:46:48 user nova-compute[75634]:     </memballoon>
Nov 15 18:46:48 user nova-compute[75634]:   </devices>
Nov 15 18:46:48 user nova-compute[75634]: </domain>
Nov 15 18:46:48 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2001652328',display_name='tempest-TestServerVolumeAttachmentScenario-server-2001652328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2001652328',id=32,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl60T3DlaUczJk2Zwoi3h9SM0ss/Q6+kUDXX1NLEIXhXMEccyD8ZK9VbqGu/P6Wn3FTrUxp/GAIoUHNmFLGUkd4JL1gR5yKh7iauBsgsUBfMMBYJwHXVDSV8PwpyMjTEg==',key_name='tempest-keypair-406405799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d234e65d9a4542b82a6d9bb0545523',ramdisk_id='',reservation_id='r-19drwqhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1721559897',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1721559897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bb679f2e1c44f8eae59835d407bb39b',uuid=615fab46-3173-4f68-b938-c88142b8836a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converting VIF {"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG os_vif [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0477a3e1-c784-5cd4-b02d-79461c6ce934', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48640e4b-6a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48640e4b-6a, col_values=(('qos', UUID('50956555-ba5b-4815-a7c5-86b8b8a6c539')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48640e4b-6a, col_values=(('external_ids', {'iface-id': '48640e4b-6a0a-4533-a947-5f9f89d26f1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:22:e6', 'vm-uuid': '615fab46-3173-4f68-b938-c88142b8836a'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:48 user nova-compute[75634]: INFO os_vif [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a')
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No VIF found with MAC fa:16:3e:7d:22:e6, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updated VIF entry in instance network info cache for port 48640e4b-6a0a-4533-a947-5f9f89d26f1d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating instance_info_cache with network_info: [{"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-40d6ac37-a3ea-48a0-9c96-45c22fab909a req-767e1cab-8fdc-4e76-841e-0e7ad8378c28 service nova] Releasing lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updated VIF entry in instance network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:48 user nova-compute[75634]: WARNING nova.compute.manager [req-ab78df9f-9e4c-4ed2-aad8-cc882da143c0 req-e511cc8f-1fb1-4d4f-a47f-d1993c9522b2 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state None.
Nov 15 18:46:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:50 user nova-compute[75634]: WARNING nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state building and task_state spawning.
Nov 15 18:46:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:50 user nova-compute[75634]: WARNING nova.compute.manager [req-7970688a-b56d-4d2b-b71f-a4848ae8592f req-d2a6d5a9-ff16-434b-a0e3-274b1dd3c8af service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state building and task_state spawning.
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] No waiting events found dispatching network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:52 user nova-compute[75634]: WARNING nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received unexpected event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d for instance with vm_state building and task_state spawning.
Nov 15 18:46:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] No waiting events found dispatching network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:52 user nova-compute[75634]: WARNING nova.compute.manager [req-58876867-347b-4d30-bc67-b25563734097 req-19b3f6f1-cd78-442f-a5de-b8dc23d16b0f service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received unexpected event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d for instance with vm_state building and task_state spawning.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance spawned successfully.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Instance spawned successfully.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Took 8.32 seconds to spawn the instance on the hypervisor.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:46:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.compute.manager [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Took 9.12 seconds to build instance.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-716d0506-7315-4883-b102-0defb34f9a6f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.226s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:53 user nova-compute[75634]: INFO nova.compute.manager [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Took 8.53 seconds to build instance.
Nov 15 18:46:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9ccc5d8a-2b23-4549-bc29-a74ca5ae2028 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.651s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:55 user nova-compute[75634]: INFO nova.compute.manager [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Rescuing
Nov 15 18:46:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:46:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:46:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:57 user nova-compute[75634]: WARNING nova.compute.manager [req-bf09391a-3efd-46b4-ab17-fdddda5c3a66 req-4dd382dd-783e-4260-b7d5-47f3f9f7b8dd service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state active and task_state rescuing.
Nov 15 18:46:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance destroyed successfully.
Nov 15 18:46:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Attempting rescue
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:46:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Creating image(s)
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue" returned: 0 in 0.063s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'migration_context' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.base [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start _get_guest_xml network_info=[{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:d3:4c:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.base [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'numa_topology' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.base [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:57 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:57 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.base [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936047067',display_name='tempest-ServerRescueNegativeTestJSON-server-936047067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936047067',id=27,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-muy1q36q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:15Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:d3:4c:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:d3:4c:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.objects.base [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:46:57 user nova-compute[75634]:   <uuid>8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</uuid>
Nov 15 18:46:57 user nova-compute[75634]:   <name>instance-0000001b</name>
Nov 15 18:46:57 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:46:57 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:46:57 user nova-compute[75634]:   <metadata>
Nov 15 18:46:57 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:46:57 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-936047067</nova:name>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:46:57</nova:creationTime>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:46:57 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:46:57 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:owner>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:46:57 user nova-compute[75634]:       </nova:owner>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:46:57 user nova-compute[75634]:       <nova:ports>
Nov 15 18:46:57 user nova-compute[75634]:         <nova:port uuid="4e3260a7-c46e-48a2-85a0-b67464a58563">
Nov 15 18:46:57 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:46:57 user nova-compute[75634]:         </nova:port>
Nov 15 18:46:57 user nova-compute[75634]:       </nova:ports>
Nov 15 18:46:57 user nova-compute[75634]:     </nova:instance>
Nov 15 18:46:57 user nova-compute[75634]:   </metadata>
Nov 15 18:46:57 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:46:57 user nova-compute[75634]:     <system>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="serial">8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</entry>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="uuid">8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44</entry>
Nov 15 18:46:57 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:46:57 user nova-compute[75634]:     </system>
Nov 15 18:46:57 user nova-compute[75634]:   </sysinfo>
Nov 15 18:46:57 user nova-compute[75634]:   <os>
Nov 15 18:46:57 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:46:57 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:46:57 user nova-compute[75634]:   </os>
Nov 15 18:46:57 user nova-compute[75634]:   <features>
Nov 15 18:46:57 user nova-compute[75634]:     <acpi/>
Nov 15 18:46:57 user nova-compute[75634]:     <apic/>
Nov 15 18:46:57 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:46:57 user nova-compute[75634]:   </features>
Nov 15 18:46:57 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:46:57 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:46:57 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:46:57 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:46:57 user nova-compute[75634]:   </clock>
Nov 15 18:46:57 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:46:57 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:46:57 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:46:57 user nova-compute[75634]:   </cpu>
Nov 15 18:46:57 user nova-compute[75634]:   <devices>
Nov 15 18:46:57 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:46:57 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:46:57 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue"/>
Nov 15 18:46:57 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:46:57 user nova-compute[75634]:     </disk>
Nov 15 18:46:57 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:46:57 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:46:57 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk"/>
Nov 15 18:46:57 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:46:57 user nova-compute[75634]:     </disk>
Nov 15 18:46:57 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:46:57 user nova-compute[75634]:       <mac address="fa:16:3e:d3:4c:ed"/>
Nov 15 18:46:57 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:57 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:46:57 user nova-compute[75634]:       <target dev="tap4e3260a7-c4"/>
Nov 15 18:46:57 user nova-compute[75634]:     </interface>
Nov 15 18:46:57 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:46:57 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/console.log" append="off"/>
Nov 15 18:46:57 user nova-compute[75634]:     </serial>
Nov 15 18:46:57 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:46:57 user nova-compute[75634]:     <video>
Nov 15 18:46:57 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:46:57 user nova-compute[75634]:     </video>
Nov 15 18:46:57 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:46:57 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:46:57 user nova-compute[75634]:     </rng>
Nov 15 18:46:57 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:46:57 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:46:57 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:46:57 user nova-compute[75634]:     </memballoon>
Nov 15 18:46:57 user nova-compute[75634]:   </devices>
Nov 15 18:46:57 user nova-compute[75634]: </domain>
Nov 15 18:46:57 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:46:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance destroyed successfully.
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:46:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:d3:4c:ed, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:46:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:46:59 user nova-compute[75634]: WARNING nova.compute.manager [req-c473ab62-8161-462b-ab54-4ae85efe994e req-924ddd83-0ce1-4d5b-bcc2-269707d62798 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state active and task_state rescuing.
Nov 15 18:46:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:46:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:01 user nova-compute[75634]: WARNING nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state active and task_state rescuing.
Nov 15 18:47:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:01 user nova-compute[75634]: WARNING nova.compute.manager [req-cc80a598-f979-481a-9b8b-8f36ad7190ae req-bab41da9-dcc9-4470-9844-e4afd99aa387 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state active and task_state rescuing.
Nov 15 18:47:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3b7c2ae1-7060-4523-b58d-612acc924625 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:47:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f is timed out.
Nov 15 18:47:03 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config.
Nov 15 18:47:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPtDKoIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb2f3c-6e7f-4e1d-95b8-e4a0dc0d089f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:47:03 user nova-compute[75634]: No targets found.
Nov 15 18:47:03 user nova-compute[75634]: iSNS:
Nov 15 18:47:03 user nova-compute[75634]: No targets found.
Nov 15 18:47:03 user nova-compute[75634]: STATIC:
Nov 15 18:47:03 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655
Nov 15 18:47:03 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:03 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:03 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:47:03 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:03 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:03 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1
Nov 15 18:47:03 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:03 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:03 user nova-compute[75634]: FIRMWARE:
Nov 15 18:47:03 user nova-compute[75634]: No targets found.
Nov 15 18:47:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:47:03 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:47:03 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f53c6-ab17-4d30-95ef-75dcbe4f4bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e034c6-ebf7-4c30-861a-b5ad19fe00d3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 (non-flash)
Nov 15 18:47:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b442d64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84f5a9-3614-4d29-8ff6-b7e42880d24d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca51fc2a-f1cb-4fa8-b712-50baef1f60d3]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec2e35-1097-4f33-8880-b1cd7740e776]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6711f-6a1d-47b8-9c17-31d10c7eeee1]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9109e687-4bb8-496e-9756-1e87faa25664]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0521e6b1-3435-47d8-bd23-caf6dcb173db]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260]
Nov 15 18:47:03 user nova-compute[75634]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:854900e1-a21c-4fed-a63e-28b59ce37655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2819fab1-fc62-422a-ad7e-083150789828]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== disconnect_volume: return (310ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:47:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3986a88b-7fe1-43b0-8820-dda067dc88b5 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-changed-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Refreshing instance network info cache due to event network-changed-3d50b190-0038-4e32-bdd4-603337580f5b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] Acquiring lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] Acquired lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Refreshing network info cache for port 3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.objects.instance [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Ignoring supplied device name: /dev/vdb
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:07 user nova-compute[75634]: INFO nova.compute.manager [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Attaching volume 63d01965-cad3-4cf3-8987-bf85934171eb to /dev/vdb
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.utils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[554be246-b3e6-42c4-9cc2-2b2fabc621be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f4035-a909-4363-9c87-bd095587695a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updated VIF entry in instance network info cache for port 3d50b190-0038-4e32-bdd4-603337580f5b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.network.neutron [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updating instance_info_cache with network_info: [{"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8bab6f-bf27-478b-accc-e16d3c60e265]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2ec7025c-5aa3-47ba-9d87-ee90603b7659 req-27ee78d7-c932-4f66-a7eb-1bf0482caba3 service nova] Releasing lock "refresh_cache-a6ea34f2-d151-4ddf-a905-a4e54b50cb95" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977eb1c-5372-47a2-a60c-f406b6bb2244]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:07 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:47:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cb2030-04bf-4e74-ab3a-50cb2f5bb659]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG os_brick.utils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:07 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updating existing volume attachment record: 6ebd8419-3217-4e99-8f02-5cde6d92ab95 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:47:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:47:12 user nova-compute[75634]: INFO nova.compute.claims [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Claim successful on node user
Nov 15 18:47:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgkMdoYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:12 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:12 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:12 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d67cd-f972-4677-b3aa-f6ee83b461b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:47:12 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a5936-5004-4cdb-87b5-1bd37f6e5ab1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb] added
Nov 15 18:47:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e087dd-3854-48f0-8c26-5b2654b7ea67]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeede585-9bfd-462e-83af-fb8ee4e339db]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgkMdoYW {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgkMdoYW" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f05ba-bd32-42bf-9717-b5b758353d98]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZgkMdoYW'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c5e62-e9d5-46bc-8ec9-0524320ae8d0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:12 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf194c2-d307-45d5-9186-877ce153bac7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6151e1e-e11b-443e-9e19-b926f02d3122]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260]
Nov 15 18:47:13 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47631e8-6ed3-4b15-8672-d0f912315099]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8756cd72-e260-4f4a-8631-0e4c4eeb37ee]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:13 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.policy [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a54ff6670dd74beea8b818f8cbd2e93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b1bd5fcf764dbda726e347edd1e63a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0680d7-f968-41a3-8a95-a8febb8df670]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgkMdoYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:47:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Creating image(s)
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "/opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk 1073741824" returned: 0 in 0.056s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Successfully created port: 091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:47:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Cannot resize image /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Ensure instance console log exists: /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23036353138646535', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036353138646535', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:47:14 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:14 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:47:14 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:14 user nova-compute[75634]:   <serial>63d01965-cad3-4cf3-8987-bf85934171eb</serial>
Nov 15 18:47:14 user nova-compute[75634]: </disk>
Nov 15 18:47:14 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Successfully updated port: 091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquired lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-changed-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Refreshing instance network info cache due to event network-changed-091c0f10-632e-4b00-b25f-b9e1ab99c33f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] Acquiring lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] No VIF found with MAC fa:16:3e:d4:95:09, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updating instance_info_cache with network_info: [{"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-13559d9f-43b0-4245-af9a-287e4bbb0afa tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.422s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Releasing lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Instance network_info: |[{"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] Acquired lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.network.neutron [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Refreshing network info cache for port 091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:47:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Start _get_guest_xml network_info=[{"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:47:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1178382398',display_name='tempest-AttachVolumeNegativeTest-server-1178382398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1178382398',id=33,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxIVjokPG/m+JiIYli0W5hDt/da7Kra/M7Z+nCaGN+na9j/uUwUoStV3spN322ktJYEa0Hx1QVnMiikoIaIi+ryrelMDZumwq+MVhM+9/RMMkkf8gIJkRz5y3NLGVKMaw==',key_name='tempest-keypair-1772097541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-a4fot6w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=bda9b595-42d5-4483-8083-32882fd6eab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'pci_devices' on Instance uuid bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:47:15 user nova-compute[75634]:   <uuid>bda9b595-42d5-4483-8083-32882fd6eab3</uuid>
Nov 15 18:47:15 user nova-compute[75634]:   <name>instance-00000021</name>
Nov 15 18:47:15 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:47:15 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:47:15 user nova-compute[75634]:   <metadata>
Nov 15 18:47:15 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:47:15 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1178382398</nova:name>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:47:15</nova:creationTime>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:47:15 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:47:15 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:owner>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:user uuid="a54ff6670dd74beea8b818f8cbd2e93c">tempest-AttachVolumeNegativeTest-1838989545-project-member</nova:user>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:project uuid="a8b1bd5fcf764dbda726e347edd1e63a">tempest-AttachVolumeNegativeTest-1838989545</nova:project>
Nov 15 18:47:15 user nova-compute[75634]:       </nova:owner>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:47:15 user nova-compute[75634]:       <nova:ports>
Nov 15 18:47:15 user nova-compute[75634]:         <nova:port uuid="091c0f10-632e-4b00-b25f-b9e1ab99c33f">
Nov 15 18:47:15 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:47:15 user nova-compute[75634]:         </nova:port>
Nov 15 18:47:15 user nova-compute[75634]:       </nova:ports>
Nov 15 18:47:15 user nova-compute[75634]:     </nova:instance>
Nov 15 18:47:15 user nova-compute[75634]:   </metadata>
Nov 15 18:47:15 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:47:15 user nova-compute[75634]:     <system>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="serial">bda9b595-42d5-4483-8083-32882fd6eab3</entry>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="uuid">bda9b595-42d5-4483-8083-32882fd6eab3</entry>
Nov 15 18:47:15 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:47:15 user nova-compute[75634]:     </system>
Nov 15 18:47:15 user nova-compute[75634]:   </sysinfo>
Nov 15 18:47:15 user nova-compute[75634]:   <os>
Nov 15 18:47:15 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:47:15 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:47:15 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:47:15 user nova-compute[75634]:   </os>
Nov 15 18:47:15 user nova-compute[75634]:   <features>
Nov 15 18:47:15 user nova-compute[75634]:     <acpi/>
Nov 15 18:47:15 user nova-compute[75634]:     <apic/>
Nov 15 18:47:15 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:47:15 user nova-compute[75634]:   </features>
Nov 15 18:47:15 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:47:15 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:47:15 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:47:15 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:47:15 user nova-compute[75634]:   </clock>
Nov 15 18:47:15 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:47:15 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:47:15 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:47:15 user nova-compute[75634]:   </cpu>
Nov 15 18:47:15 user nova-compute[75634]:   <devices>
Nov 15 18:47:15 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:47:15 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:47:15 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk"/>
Nov 15 18:47:15 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:47:15 user nova-compute[75634]:     </disk>
Nov 15 18:47:15 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:47:15 user nova-compute[75634]:       <mac address="fa:16:3e:a8:9a:65"/>
Nov 15 18:47:15 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:47:15 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:47:15 user nova-compute[75634]:       <target dev="tap091c0f10-63"/>
Nov 15 18:47:15 user nova-compute[75634]:     </interface>
Nov 15 18:47:15 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:47:15 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/console.log" append="off"/>
Nov 15 18:47:15 user nova-compute[75634]:     </serial>
Nov 15 18:47:15 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:47:15 user nova-compute[75634]:     <video>
Nov 15 18:47:15 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:47:15 user nova-compute[75634]:     </video>
Nov 15 18:47:15 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:47:15 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:47:15 user nova-compute[75634]:     </rng>
Nov 15 18:47:15 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:47:15 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:47:15 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:47:15 user nova-compute[75634]:     </memballoon>
Nov 15 18:47:15 user nova-compute[75634]:   </devices>
Nov 15 18:47:15 user nova-compute[75634]: </domain>
Nov 15 18:47:15 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1178382398',display_name='tempest-AttachVolumeNegativeTest-server-1178382398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1178382398',id=33,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxIVjokPG/m+JiIYli0W5hDt/da7Kra/M7Z+nCaGN+na9j/uUwUoStV3spN322ktJYEa0Hx1QVnMiikoIaIi+ryrelMDZumwq+MVhM+9/RMMkkf8gIJkRz5y3NLGVKMaw==',key_name='tempest-keypair-1772097541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-a4fot6w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=bda9b595-42d5-4483-8083-32882fd6eab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG os_vif [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47faef5f-ff23-553e-96f6-90c51836f6cc', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091c0f10-63, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091c0f10-63, col_values=(('qos', UUID('003a1360-d1dc-4f9a-9617-eb2256544122')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091c0f10-63, col_values=(('external_ids', {'iface-id': '091c0f10-632e-4b00-b25f-b9e1ab99c33f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:9a:65', 'vm-uuid': 'bda9b595-42d5-4483-8083-32882fd6eab3'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:15 user nova-compute[75634]: INFO os_vif [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63')
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:a8:9a:65, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.neutron [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updated VIF entry in instance network info cache for port 091c0f10-632e-4b00-b25f-b9e1ab99c33f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG nova.network.neutron [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updating instance_info_cache with network_info: [{"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-faf089c2-9838-4de7-be00-61efbb512493 req-ceee2c3c-fecc-4fd2-90ef-cd2828ddf944 service nova] Releasing lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing instance network info cache due to event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] Acquiring lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] Acquired lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.objects.instance [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updated VIF entry in instance network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26197dc6-22e8-4367-bad0-638c5a1fa499 req-bbe5f8ea-6130-46b2-98b3-eeea7fae80ba service nova] Releasing lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:16 user nova-compute[75634]: INFO nova.compute.manager [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Attaching volume 7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 to /dev/vdb
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] No waiting events found dispatching network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:16 user nova-compute[75634]: WARNING nova.compute.manager [req-c455944c-2d74-46a3-866e-1c43ab253ae4 req-7776a9e1-9a36-488a-b913-e4a12b00206c service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received unexpected event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f for instance with vm_state building and task_state spawning.
Nov 15 18:47:16 user nova-compute[75634]: DEBUG os_brick.utils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c1190-221e-4f8a-a067-19665ca892d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a2a00-c615-4ae1-a361-45270eabbea8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286fc06-2ce8-453c-b0f0-2fee1b066726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[736054e6-2472-4e63-bc2e-c4aa0f3ad13d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:17 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:47:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c112f-23be-433f-a729-14f5623f2fff]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG os_brick.utils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating existing volume attachment record: c3626a0a-f2e0-40aa-a838-9bba3ec739cc {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:47:18 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Instance spawned successfully.
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:47:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] No waiting events found dispatching network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:19 user nova-compute[75634]: WARNING nova.compute.manager [req-f55d2ff6-ecff-45de-be67-29e549e60f79 req-200b17ae-a357-4c77-934b-793ae6e0b0aa service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received unexpected event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f for instance with vm_state building and task_state spawning.
Nov 15 18:47:19 user nova-compute[75634]: INFO nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 15 18:47:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:47:19 user nova-compute[75634]: INFO nova.compute.manager [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Took 6.65 seconds to build instance.
Nov 15 18:47:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5391d66d-0097-4cf9-90ec-abe52897a954 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.765s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:21 user nova-compute[75634]: INFO nova.compute.manager [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Terminating instance
Nov 15 18:47:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-unplugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] No waiting events found dispatching network-vif-unplugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-c3479ee4-d63e-4ac0-9587-b33d95f2afa1 req-ab4a1a4b-7f30-4ef9-88be-a36b0400ce63 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-unplugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmhTpasH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:22 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:22 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:22 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[739651ad-824e-4a1f-9563-9622692e3f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:47:22 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[705c5b3b-5078-4375-8841-ba204e1a1df3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1] added
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9372bf50-a13a-4a91-932d-0e4a74a6456c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe16477-d691-4766-b33c-06558c82ee5a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmhTpasH {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmhTpasH" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3648796-3458-4eab-9a87-6f9f1dcd6899]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmhTpasH'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2836055-dea3-4b56-8079-b1b151b1fc5f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e30f6-5c10-45bb-9986-39af941e1525]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0472a4-da51-4ad8-9ff7-f044e39ac150]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260]
Nov 15 18:47:22 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a7dee-3688-462b-ba29-7674130b8939]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c34623a-c024-491c-8af1-e1b1dc2a26dc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:22 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb429fe-ac64-4adb-a683-cd5d40fc069c]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmhTpasH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:47:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Instance destroyed successfully.
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid 293ff492-91e9-420a-a772-d3cc5420c905 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2075444835',display_name='tempest-TestVolumeBootPattern-server-2075444835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2075444835',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-rgr470k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:45:50Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=293ff492-91e9-420a-a772-d3cc5420c905,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "address": "fa:16:3e:df:91:b4", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c57b5a-e4", "ovs_interfaceid": "23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_vif [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c57b5a-e4, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32abe0ef-a9df-4081-8e83-2b67af7c09ec) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:22 user nova-compute[75634]: INFO os_vif [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c57b5a-e4')
Nov 15 18:47:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrvHeywC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:22 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23636666433633137', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636666433633137', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.895s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG nova.objects.instance [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[922ebbea-4c4f-4e58-8086-44756e8eeeb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:47:23 user nova-compute[75634]: No targets found.
Nov 15 18:47:23 user nova-compute[75634]: iSNS:
Nov 15 18:47:23 user nova-compute[75634]: No targets found.
Nov 15 18:47:23 user nova-compute[75634]: STATIC:
Nov 15 18:47:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1
Nov 15 18:47:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb
Nov 15 18:47:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:47:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:23 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1
Nov 15 18:47:23 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:23 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:23 user nova-compute[75634]: FIRMWARE:
Nov 15 18:47:23 user nova-compute[75634]: No targets found.
Nov 15 18:47:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:47:23 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:47:23 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:47:23 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:23 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:47:23 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:23 user nova-compute[75634]:   <serial>7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1</serial>
Nov 15 18:47:23 user nova-compute[75634]: </disk>
Nov 15 18:47:23 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00ca36-6348-4e1a-90e1-93cf2c766bf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058862b-eea2-4f6e-98b5-357007e001ff]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:23 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44477640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c840e-47e3-46c3-98bf-70a251f6a24e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bb72b1-93a2-4052-b3cb-7e8e8917e548]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ef3eb-140f-4b02-ac52-8ea16951f6f5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc48233-b9a3-4435-88d2-144630347c27]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee4adad-c99f-42ff-8c79-1b6c50a403d2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[51455d42-471d-4464-a950-7fb07e13b2f9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260]
Nov 15 18:47:23 user nova-compute[75634]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:23 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:087bc9ca-1359-4a19-9487-8bd35a7c05a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb23500-ec4b-4019-8ca7-87f9977e43f4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (1254ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:47:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Deleting instance files /opt/stack/data/nova/instances/293ff492-91e9-420a-a772-d3cc5420c905_del
Nov 15 18:47:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Deletion of /opt/stack/data/nova/instances/293ff492-91e9-420a-a772-d3cc5420c905_del complete
Nov 15 18:47:24 user nova-compute[75634]: INFO nova.compute.manager [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Took 2.23 seconds to destroy the instance on the hypervisor.
Nov 15 18:47:24 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] No VIF found with MAC fa:16:3e:c6:e7:27, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] Acquiring lock "293ff492-91e9-420a-a772-d3cc5420c905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] Lock "293ff492-91e9-420a-a772-d3cc5420c905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] No waiting events found dispatching network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:24 user nova-compute[75634]: WARNING nova.compute.manager [req-d06288b9-91b1-4087-8af9-95e9c921578d req-5ff0d909-b531-4d3f-b051-f50a70dc8275 service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received unexpected event network-vif-plugged-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 for instance with vm_state active and task_state deleting.
Nov 15 18:47:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-39fba3d1-5636-462d-8949-5e75d49e5651 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.384s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:24 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Took 0.50 seconds to deallocate network for instance.
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-4689ec49-4b43-4514-ab09-ee9646656a35 req-73315f32-a9fb-4c2a-980a-0235670910be service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Received event network-vif-deleted-23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:24 user nova-compute[75634]: INFO nova.compute.manager [req-4689ec49-4b43-4514-ab09-ee9646656a35 req-73315f32-a9fb-4c2a-980a-0235670910be service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Neutron deleted interface 23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9; detaching it from the instance and deleting it from the info cache
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.network.neutron [req-4689ec49-4b43-4514-ab09-ee9646656a35 req-73315f32-a9fb-4c2a-980a-0235670910be service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-4689ec49-4b43-4514-ab09-ee9646656a35 req-73315f32-a9fb-4c2a-980a-0235670910be service nova] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Detach interface failed, port_id=23c57b5a-e4ef-48fd-9fb7-27dbe2779cc9, reason: Instance 293ff492-91e9-420a-a772-d3cc5420c905 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:47:25 user nova-compute[75634]: INFO nova.compute.manager [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 293ff492-91e9-420a-a772-d3cc5420c905] Deleting volume: 087bc9ca-1359-4a19-9487-8bd35a7c05a1 {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:25 user nova-compute[75634]: INFO nova.compute.manager [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Detaching volume 7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:25 user nova-compute[75634]: INFO nova.virt.block_device [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Attempting to driver detach volume 7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 from mountpoint /dev/vdb
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Attempting to detach device vdb from instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:25 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:25 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:47:25 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:25 user nova-compute[75634]:   <serial>7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1</serial>
Nov 15 18:47:25 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:25 user nova-compute[75634]: </disk>
Nov 15 18:47:25 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully detached device vdb from instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 from the persistent domain config.
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:25 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:25 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:47:25 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:25 user nova-compute[75634]:   <serial>7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1</serial>
Nov 15 18:47:25 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:25 user nova-compute[75634]: </disk>
Nov 15 18:47:25 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:47:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:26 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance 293ff492-91e9-420a-a772-d3cc5420c905
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6839eff6-0691-4f59-9d2a-57af7c56c1de tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "293ff492-91e9-420a-a772-d3cc5420c905" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.383s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:26 user nova-compute[75634]: INFO nova.compute.manager [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Detaching volume 63d01965-cad3-4cf3-8987-bf85934171eb
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:26 user nova-compute[75634]: INFO nova.virt.block_device [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Attempting to driver detach volume 63d01965-cad3-4cf3-8987-bf85934171eb from mountpoint /dev/vdb
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Attempting to detach device vdb from instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:26 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:26 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:47:26 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:26 user nova-compute[75634]:   <serial>63d01965-cad3-4cf3-8987-bf85934171eb</serial>
Nov 15 18:47:26 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:26 user nova-compute[75634]: </disk>
Nov 15 18:47:26 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully detached device vdb from instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 from the persistent domain config.
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:26 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:26 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:47:26 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:26 user nova-compute[75634]:   <serial>63d01965-cad3-4cf3-8987-bf85934171eb</serial>
Nov 15 18:47:26 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:26 user nova-compute[75634]: </disk>
Nov 15 18:47:26 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:31 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7010MB free_disk=24.859115600585938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 615fab46-3173-4f68-b938-c88142b8836a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance bda9b595-42d5-4483-8083-32882fd6eab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 18:47:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 18:47:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:35 user nova-compute[75634]: INFO nova.compute.manager [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attaching volume 773da2bc-a829-4453-994d-8b163b893eb5 to /dev/vdb
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.utils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4b455-5f34-4173-bff5-e24ae7b1a18c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b993f7-a401-41d2-8f6a-0b19ffc105e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[572061f1-f8b6-481c-bdc4-a947e866d53a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f279fb3-a344-4ed2-9ea9-edb358226a0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:35 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:47:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae3374-d421-4d17-99e1-17a825af5f6a]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG os_brick.utils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:35 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating existing volume attachment record: 34773500-5e00-4b2c-a842-ecd5c2c0bb83 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:47:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:39 user nova-compute[75634]: INFO nova.compute.manager [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Unshelving
Nov 15 18:47:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_requests' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'numa_topology' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:47:39 user nova-compute[75634]: INFO nova.compute.claims [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Claim successful on node user
Nov 15 18:47:39 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:39 user nova-compute[75634]: INFO nova.network.neutron [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating port bef57442-7b6f-4366-9270-099f4bd4698d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbztLlQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:40 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[426f1d8a-065c-40b0-a42e-e4c590dee45a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:47:40 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2daeed4-6c07-445b-a14a-0a1fc38f6181]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5] added
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b578c-d61d-42d5-a793-64f3f5127dbf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2deeb-2099-4f5e-b2b9-58fbf1052f29]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbztLlQw {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbztLlQw" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4e0063-c2a5-4052-8c17-656acc898b0d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbztLlQw'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3dde80-fa6a-44a4-b588-05ef3d345c08]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db9d0c9-0162-4baf-b201-43788eaa1ef4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7677cb-a268-4fe5-977f-132b837e632f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260]
Nov 15 18:47:40 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[14968ace-c103-4692-9f23-142f685d9ebd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89a1687-5766-45e2-a3f2-f3edf3fa6744]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing instance network info cache due to event network-changed-bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] Acquiring lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50946bb7-2fc6-4964-a9d7-69ce85d1441e]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbztLlQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:47:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Creating image(s)
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] Acquired lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Refreshing network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG nova.objects.base [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<c9581bab-c679-4d43-8e8b-8cc445c22060> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.917s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== connect_volume: return (1920ms) {'type': 'block', 'scsi_wwn': '23331633865363531', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331633865363531', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:47:41 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:41 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:47:41 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:41 user nova-compute[75634]:   <serial>773da2bc-a829-4453-994d-8b163b893eb5</serial>
Nov 15 18:47:41 user nova-compute[75634]: </disk>
Nov 15 18:47:41 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.virt.images [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] 3079493f-18e4-4292-b5ea-3519cbed1c17 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.part /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updated VIF entry in instance network info cache for port bef57442-7b6f-4366-9270-099f4bd4698d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ff78905-bbe7-45c6-bc34-3f78126a2bae req-390a0f08-0c73-4ef0-b96a-5eeb3a846691 service nova] Releasing lock "refresh_cache-c9581bab-c679-4d43-8e8b-8cc445c22060" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.part /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.converted" returned: 0 in 0.307s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] No VIF found with MAC fa:16:3e:5c:a4:b0, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.586s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cca011e3-f924-444b-8411-acee4abd8d12 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.537s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa,backing_fmt=raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa,backing_fmt=raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk 1073741824" returned: 0 in 0.054s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "136756019ae4d8bc93c2218f43b7b2f70a3d96fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'migration_context' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<c9581bab-c679-4d43-8e8b-8cc445c22060> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:47:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Rebasing disk image.
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 -F raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:45 user nova-compute[75634]: INFO nova.compute.manager [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Detaching volume 773da2bc-a829-4453-994d-8b163b893eb5
Nov 15 18:47:45 user nova-compute[75634]: INFO nova.virt.block_device [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Attempting to driver detach volume 773da2bc-a829-4453-994d-8b163b893eb5 from mountpoint /dev/vdb
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Attempting to detach device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:45 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:45 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:47:45 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:45 user nova-compute[75634]:   <serial>773da2bc-a829-4453-994d-8b163b893eb5</serial>
Nov 15 18:47:45 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:45 user nova-compute[75634]: </disk>
Nov 15 18:47:45 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:45 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the persistent domain config.
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:47:45 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:47:45 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 18:47:45 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:47:45 user nova-compute[75634]:   <serial>773da2bc-a829-4453-994d-8b163b893eb5</serial>
Nov 15 18:47:45 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:47:45 user nova-compute[75634]: </disk>
Nov 15 18:47:45 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 -F raw /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk" returned: 0 in 2.384s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Ensure instance console log exists: /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start _get_guest_xml network_info=[{"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b36c669f4c2d69222ded57a039572d76',container_format='bare',created_at=2023-11-15T18:45:46Z,direct_url=<?>,disk_format='qcow2',id=3079493f-18e4-4292-b5ea-3519cbed1c17,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1273182834-shelved',owner='38d2c43038b241429feffe23bbbf4f1d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T18:45:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:47:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b36c669f4c2d69222ded57a039572d76',container_format='bare',created_at=2023-11-15T18:45:46Z,direct_url=<?>,disk_format='qcow2',id=3079493f-18e4-4292-b5ea-3519cbed1c17,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1273182834-shelved',owner='38d2c43038b241429feffe23bbbf4f1d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T18:45:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.objects.base [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<c9581bab-c679-4d43-8e8b-8cc445c22060> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='3079493f-18e4-4292-b5ea-3519cbed1c17',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1393165220',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:45:51.690612',shelved_host='user',shelved_image_id='3079493f-18e4-4292-b5ea-3519cbed1c17'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'pci_devices' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.objects.base [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Object Instance<c9581bab-c679-4d43-8e8b-8cc445c22060> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:47:45 user nova-compute[75634]:   <uuid>c9581bab-c679-4d43-8e8b-8cc445c22060</uuid>
Nov 15 18:47:45 user nova-compute[75634]:   <name>instance-00000018</name>
Nov 15 18:47:45 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:47:45 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:47:45 user nova-compute[75634]:   <metadata>
Nov 15 18:47:45 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:47:45 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1273182834</nova:name>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:47:45</nova:creationTime>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:47:45 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:47:45 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:owner>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:user uuid="6642c8d206564bc5b510ce6ead09fc2c">tempest-AttachVolumeShelveTestJSON-1234122392-project-member</nova:user>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:project uuid="38d2c43038b241429feffe23bbbf4f1d">tempest-AttachVolumeShelveTestJSON-1234122392</nova:project>
Nov 15 18:47:45 user nova-compute[75634]:       </nova:owner>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:root type="image" uuid="3079493f-18e4-4292-b5ea-3519cbed1c17"/>
Nov 15 18:47:45 user nova-compute[75634]:       <nova:ports>
Nov 15 18:47:45 user nova-compute[75634]:         <nova:port uuid="bef57442-7b6f-4366-9270-099f4bd4698d">
Nov 15 18:47:45 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 18:47:45 user nova-compute[75634]:         </nova:port>
Nov 15 18:47:45 user nova-compute[75634]:       </nova:ports>
Nov 15 18:47:45 user nova-compute[75634]:     </nova:instance>
Nov 15 18:47:45 user nova-compute[75634]:   </metadata>
Nov 15 18:47:45 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:47:45 user nova-compute[75634]:     <system>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="serial">c9581bab-c679-4d43-8e8b-8cc445c22060</entry>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="uuid">c9581bab-c679-4d43-8e8b-8cc445c22060</entry>
Nov 15 18:47:45 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:47:45 user nova-compute[75634]:     </system>
Nov 15 18:47:45 user nova-compute[75634]:   </sysinfo>
Nov 15 18:47:45 user nova-compute[75634]:   <os>
Nov 15 18:47:45 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:47:45 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:47:45 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:47:45 user nova-compute[75634]:   </os>
Nov 15 18:47:45 user nova-compute[75634]:   <features>
Nov 15 18:47:45 user nova-compute[75634]:     <acpi/>
Nov 15 18:47:45 user nova-compute[75634]:     <apic/>
Nov 15 18:47:45 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:47:45 user nova-compute[75634]:   </features>
Nov 15 18:47:45 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:47:45 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:47:45 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:47:45 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:47:45 user nova-compute[75634]:   </clock>
Nov 15 18:47:45 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:47:45 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:47:45 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:47:45 user nova-compute[75634]:   </cpu>
Nov 15 18:47:45 user nova-compute[75634]:   <devices>
Nov 15 18:47:45 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:47:45 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:47:45 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk"/>
Nov 15 18:47:45 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:47:45 user nova-compute[75634]:     </disk>
Nov 15 18:47:45 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:47:45 user nova-compute[75634]:       <mac address="fa:16:3e:d2:ec:18"/>
Nov 15 18:47:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:47:45 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:47:45 user nova-compute[75634]:       <target dev="tapbef57442-7b"/>
Nov 15 18:47:45 user nova-compute[75634]:     </interface>
Nov 15 18:47:45 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:47:45 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/console.log" append="off"/>
Nov 15 18:47:45 user nova-compute[75634]:     </serial>
Nov 15 18:47:45 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:47:45 user nova-compute[75634]:     <video>
Nov 15 18:47:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:47:45 user nova-compute[75634]:     </video>
Nov 15 18:47:45 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:47:45 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:47:45 user nova-compute[75634]:     </rng>
Nov 15 18:47:45 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:47:45 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:47:45 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:47:45 user nova-compute[75634]:     </memballoon>
Nov 15 18:47:45 user nova-compute[75634]:   </devices>
Nov 15 18:47:45 user nova-compute[75634]: </domain>
Nov 15 18:47:45 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='3079493f-18e4-4292-b5ea-3519cbed1c17',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1393165220',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member',shelved_at='2023-11-15T18:45:51.690612',shelved_host='user',shelved_image_id='3079493f-18e4-4292-b5ea-3519cbed1c17'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG os_vif [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19699328-e583-5991-95a3-10bfa3fcf2f5', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef57442-7b, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbef57442-7b, col_values=(('qos', UUID('7ac1edce-27c0-4a34-99c0-7c15a3e4b695')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbef57442-7b, col_values=(('external_ids', {'iface-id': 'bef57442-7b6f-4366-9270-099f4bd4698d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ec:18', 'vm-uuid': 'c9581bab-c679-4d43-8e8b-8cc445c22060'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:45 user nova-compute[75634]: INFO os_vif [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b')
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:47:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] No VIF found with MAC fa:16:3e:d2:ec:18, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:46 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 is timed out.
Nov 15 18:47:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully detached device vdb from instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 from the live domain config.
Nov 15 18:47:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmhTpasH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:46 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22f5c0-3546-4d79-aa1a-89653a197b50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:47:46 user nova-compute[75634]: No targets found.
Nov 15 18:47:46 user nova-compute[75634]: iSNS:
Nov 15 18:47:46 user nova-compute[75634]: No targets found.
Nov 15 18:47:46 user nova-compute[75634]: STATIC:
Nov 15 18:47:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1
Nov 15 18:47:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb
Nov 15 18:47:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5
Nov 15 18:47:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:46 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:47:46 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:46 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:46 user nova-compute[75634]: FIRMWARE:
Nov 15 18:47:46 user nova-compute[75634]: No targets found.
Nov 15 18:47:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:47:46 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:47:46 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[de865195-9fc4-46a1-bc9a-bc1c054a59cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2665dd-1bf9-4918-81f7-fbf4a699868c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68296ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e87214d-730a-4aa8-8d6a-7835810abd7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e23896-54f3-43b7-be20-89950c39fce5]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8283c4-7596-4868-8490-6c8c49952e35]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f81fe72-e8fc-4b2b-b79a-b07caff4ebb7]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8ea3a-974d-4366-bbbe-da664a90f2a9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4abc8f5-aa35-499a-bd69-460e64b07936]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260]
Nov 15 18:47:46 user nova-compute[75634]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:46 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a71f5ad-3bae-42e1-825a-dd1c5cd2a4d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e7c01-d61c-468d-9c22-732b70399c19]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] <== disconnect_volume: return (336ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:47:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 is timed out.
Nov 15 18:47:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully detached device vdb from instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95 from the live domain config.
Nov 15 18:47:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgkMdoYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cdf64c-e632-4ee5-bcc0-2922ba13048f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:47:47 user nova-compute[75634]: No targets found.
Nov 15 18:47:47 user nova-compute[75634]: iSNS:
Nov 15 18:47:47 user nova-compute[75634]: No targets found.
Nov 15 18:47:47 user nova-compute[75634]: STATIC:
Nov 15 18:47:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb
Nov 15 18:47:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5
Nov 15 18:47:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:47:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:47 user nova-compute[75634]: FIRMWARE:
Nov 15 18:47:47 user nova-compute[75634]: No targets found.
Nov 15 18:47:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:47:47 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:47:47 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da929f0-7a57-4704-bd82-60b99c7f6bbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f85ff-abad-49ee-9492-19a9f7c8ed81]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:47 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:47 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:47 user nova-compute[75634]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb (non-flash)
Nov 15 18:47:47 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b443103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae1cab-5208-4b13-b856-61b2b9488669]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[47284d2f-eb6e-49c5-a5e2-73de03de6a16]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd3e448-12a0-4d04-964d-0f0c6adddda1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf58165-57b0-4009-bc92-0f57f46adc2c]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bdef4-0d69-4c27-a0aa-5295fe27b53b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[74001c36-d6e4-4ba4-aa4f-ce96df929eec]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260]
Nov 15 18:47:47 user nova-compute[75634]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb, portal: 172.16.0.220,3260] successful.
Nov 15 18:47:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'flavor' on Instance uuid 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae5ddd-0fe1-4f9b-b703-2509490820d3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== disconnect_volume: return (318ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b72cc4b6-a548-466d-806f-48f424ea7046 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.781s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:47 user nova-compute[75634]: WARNING nova.compute.manager [req-e0f3d663-5665-4cad-be93-0a78339a9746 req-3a3d6479-d6e5-49ff-8144-5dae1901aa58 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 18:47:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'flavor' on Instance uuid a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a5b053e8-a9d2-4938-b8ca-0a91d40db76e tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.651s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:48 user nova-compute[75634]: INFO nova.compute.manager [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Terminating instance
Nov 15 18:47:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-unplugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] No waiting events found dispatching network-vif-unplugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-1364d9d7-96b4-454b-b59e-80f53c5ce7fd req-0fa245fa-e181-47bb-9b9d-64c8fbe3c01d service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-unplugged-3d50b190-0038-4e32-bdd4-603337580f5b for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:47:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Instance destroyed successfully.
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lazy-loading 'resources' on Instance uuid a6ea34f2-d151-4ddf-a905-a4e54b50cb95 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1909585895',display_name='tempest-VolumesSnapshotTestJSON-instance-1909585895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1909585895',id=28,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh5y1xPMS9VP9nMa2579oaTKx+xNy4er4aCkPkmGrvdwQMR4i4xGLDPE+4ChrjfdD7vzSGoZ9z/xpWf6nHboF09lt3/SXh/og0aLOLnq5VBxVS0LdcckKANUtv6A9yEuQ==',key_name='tempest-keypair-1493302441',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb145ba27ca5420591deefadf264ff39',ramdisk_id='',reservation_id='r-cd77uqj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2133351772',owner_user_name='tempest-VolumesSnapshotTestJSON-2133351772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5ccd186caec4537a98be34699d1a1a1',uuid=a6ea34f2-d151-4ddf-a905-a4e54b50cb95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converting VIF {"id": "3d50b190-0038-4e32-bdd4-603337580f5b", "address": "fa:16:3e:d4:95:09", "network": {"id": "6f7dce19-bfac-46ba-b5e7-d2042c5d4419", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-688171478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb145ba27ca5420591deefadf264ff39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50b190-00", "ovs_interfaceid": "3d50b190-0038-4e32-bdd4-603337580f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_vif [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d50b190-00, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=118dbe40-31d3-4a11-a725-65560ca8f6b5) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:49 user nova-compute[75634]: INFO os_vif [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:09,bridge_name='br-int',has_traffic_filtering=True,id=3d50b190-0038-4e32-bdd4-603337580f5b,network=Network(6f7dce19-bfac-46ba-b5e7-d2042c5d4419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50b190-00')
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgkMdoYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:49 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efb55e3-8170-4407-bdde-58aa339372f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:47:49 user nova-compute[75634]: No targets found.
Nov 15 18:47:49 user nova-compute[75634]: iSNS:
Nov 15 18:47:49 user nova-compute[75634]: No targets found.
Nov 15 18:47:49 user nova-compute[75634]: STATIC:
Nov 15 18:47:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5
Nov 15 18:47:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:49 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:47:49 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:47:49 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:47:49 user nova-compute[75634]: FIRMWARE:
Nov 15 18:47:49 user nova-compute[75634]: No targets found.
Nov 15 18:47:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:47:49 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:47:49 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d01965-cad3-4cf3-8987-bf85934171eb', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab228e6e-03ab-4884-b4f5-5092d205614a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e15c1-0dab-4d60-9ce1-8ceb643c67fa]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:49 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:47:49 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:47:49 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b685df760>, {}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Disconnecting from: [] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] <== disconnect_volume: return (74ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:47:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Deleting instance files /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95_del
Nov 15 18:47:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Deletion of /opt/stack/data/nova/instances/a6ea34f2-d151-4ddf-a905-a4e54b50cb95_del complete
Nov 15 18:47:49 user nova-compute[75634]: INFO nova.compute.manager [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:49 user nova-compute[75634]: WARNING nova.compute.manager [req-df631477-ac22-4ea5-853b-dacbeeeedda5 req-3c371cae-fb75-4d10-9b2b-47e45d431c7b service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:47:49 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:47:49 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance spawned successfully.
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c60c99a2-0ccf-4ed5-9031-36100931efcf tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.059s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:47:50 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Took 0.79 seconds to deallocate network for instance.
Nov 15 18:47:50 user nova-compute[75634]: WARNING nova.volume.cinder [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Attachment 6ebd8419-3217-4e99-8f02-5cde6d92ab95 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6ebd8419-3217-4e99-8f02-5cde6d92ab95. (HTTP 404) (Request-ID: req-f10e02d7-3d69-4f4b-a2c4-086cdc56f55a)
Nov 15 18:47:50 user nova-compute[75634]: INFO nova.compute.manager [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] Acquiring lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] No waiting events found dispatching network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:47:50 user nova-compute[75634]: WARNING nova.compute.manager [req-c6574fa9-30d6-4af5-bf21-55c07cd6ac9c req-b261f5a4-4df1-46cb-8033-6a1af77a784b service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received unexpected event network-vif-plugged-3d50b190-0038-4e32-bdd4-603337580f5b for instance with vm_state deleted and task_state None.
Nov 15 18:47:50 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Deleted allocations for instance a6ea34f2-d151-4ddf-a905-a4e54b50cb95
Nov 15 18:47:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3971fab8-3113-4bec-9195-63bfd5038662 tempest-VolumesSnapshotTestJSON-2133351772 tempest-VolumesSnapshotTestJSON-2133351772-project-member] Lock "a6ea34f2-d151-4ddf-a905-a4e54b50cb95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-37284835-b4d9-4c99-9d23-e574571298fd req-519eeacb-fc1b-4483-beb4-48b5416e2a02 service nova] [instance: a6ea34f2-d151-4ddf-a905-a4e54b50cb95] Received event network-vif-deleted-3d50b190-0038-4e32-bdd4-603337580f5b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:47:57 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:47:57 user nova-compute[75634]: INFO nova.compute.claims [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Claim successful on node user
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:47:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:47:58 user nova-compute[75634]: INFO nova.virt.block_device [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Booting with volume 05e6d5f5-0f70-4f79-a6e8-44208773bbec at /dev/vda
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.policy [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ebb5c4075034b1482d50a9ff5dd990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb5adcf609a4fd7a67d3574243cc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.utils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[566c5cb5-a2dc-42e7-a663-8613d117ea5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[99389774-5fbd-438e-a39a-bdbb7ada2b8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e077d-8959-4883-8297-a3b862f29e10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5636e0-98b3-4bc8-a9fd-58807db56d52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:47:58 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:47:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8546a6f-9116-4b00-be74-12eca00a3522]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG os_brick.utils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:47:58 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating existing volume attachment record: 5254f100-6b0e-4a78-aa56-6d6827b20c67 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Successfully created port: 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Successfully updated port: 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-changed-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Refreshing instance network info cache due to event network-changed-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:47:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance network_info: |[{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.network.neutron [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Refreshing network info cache for port 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.network.neutron [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updated VIF entry in instance network info cache for port 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG nova.network.neutron [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a3b0f05a-f65b-4adf-a748-e6199fbfbfc6 req-c030a040-0f13-4c3d-94cd-73c1a61be2d2 service nova] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:48:03 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Creating image(s)
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Ensure instance console log exists: /opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start _get_guest_xml network_info=[{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6903a62f-7273-4616-9f37-a072c7e47c48', 'attached_at': '', 'detached_at': '', 'volume_id': '05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'serial': '05e6d5f5-0f70-4f79-a6e8-44208773bbec'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '5254f100-6b0e-4a78-aa56-6d6827b20c67', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:48:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:03 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:03 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be208448-0871-49c4-acf6-be8ba289e5e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:48:03 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb3922-0285-406f-a706-ced184110c9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec] added
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9438ab-f036-4098-b1d3-93bdf20832eb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5edb0-e90c-4605-beb6-b9e53ca587c2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syMdZPat {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syMdZPat" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45ae0e-6a77-4b47-acb8-3fc52c80ec2f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syMdZPat'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5437a024-2c1c-454a-bf7a-f1caed6e62c9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58bef78-de6d-4f49-91e4-46731b417516]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f74f4-1b37-4f79-90f0-c3bf24a198c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]
Nov 15 18:48:03 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a5563-eb66-42ea-a5ce-5bb197630a1b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a455b-497a-4947-89fc-cb242695584f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:03 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:03 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4b800c-165f-4663-a589-a14fbf7d3770]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:48:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:48:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:04 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23763666661396564', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763666661396564', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'pci_devices' on Instance uuid 6903a62f-7273-4616-9f37-a072c7e47c48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:48:05 user nova-compute[75634]:   <uuid>6903a62f-7273-4616-9f37-a072c7e47c48</uuid>
Nov 15 18:48:05 user nova-compute[75634]:   <name>instance-00000022</name>
Nov 15 18:48:05 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:48:05 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:48:05 user nova-compute[75634]:   <metadata>
Nov 15 18:48:05 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:48:05 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:48:05 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherA-server-1783177436</nova:name>
Nov 15 18:48:05 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:48:03</nova:creationTime>
Nov 15 18:48:05 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:48:05 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:48:05 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:48:05 user nova-compute[75634]:       <nova:owner>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:user uuid="3ebb5c4075034b1482d50a9ff5dd990b">tempest-ServerActionsTestOtherA-1839012723-project-member</nova:user>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:project uuid="0fb5adcf609a4fd7a67d3574243cc920">tempest-ServerActionsTestOtherA-1839012723</nova:project>
Nov 15 18:48:05 user nova-compute[75634]:       </nova:owner>
Nov 15 18:48:05 user nova-compute[75634]:       <nova:ports>
Nov 15 18:48:05 user nova-compute[75634]:         <nova:port uuid="3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b">
Nov 15 18:48:05 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:48:05 user nova-compute[75634]:         </nova:port>
Nov 15 18:48:05 user nova-compute[75634]:       </nova:ports>
Nov 15 18:48:05 user nova-compute[75634]:     </nova:instance>
Nov 15 18:48:05 user nova-compute[75634]:   </metadata>
Nov 15 18:48:05 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:48:05 user nova-compute[75634]:     <system>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="serial">6903a62f-7273-4616-9f37-a072c7e47c48</entry>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="uuid">6903a62f-7273-4616-9f37-a072c7e47c48</entry>
Nov 15 18:48:05 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:48:05 user nova-compute[75634]:     </system>
Nov 15 18:48:05 user nova-compute[75634]:   </sysinfo>
Nov 15 18:48:05 user nova-compute[75634]:   <os>
Nov 15 18:48:05 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:48:05 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:48:05 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:48:05 user nova-compute[75634]:   </os>
Nov 15 18:48:05 user nova-compute[75634]:   <features>
Nov 15 18:48:05 user nova-compute[75634]:     <acpi/>
Nov 15 18:48:05 user nova-compute[75634]:     <apic/>
Nov 15 18:48:05 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:48:05 user nova-compute[75634]:   </features>
Nov 15 18:48:05 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:48:05 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:48:05 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:48:05 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:48:05 user nova-compute[75634]:   </clock>
Nov 15 18:48:05 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:48:05 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:48:05 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:48:05 user nova-compute[75634]:   </cpu>
Nov 15 18:48:05 user nova-compute[75634]:   <devices>
Nov 15 18:48:05 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:48:05 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:48:05 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:48:05 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:48:05 user nova-compute[75634]:       <serial>05e6d5f5-0f70-4f79-a6e8-44208773bbec</serial>
Nov 15 18:48:05 user nova-compute[75634]:     </disk>
Nov 15 18:48:05 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:48:05 user nova-compute[75634]:       <mac address="fa:16:3e:5b:2b:88"/>
Nov 15 18:48:05 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:48:05 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:48:05 user nova-compute[75634]:       <target dev="tap3b2f8a3e-2a"/>
Nov 15 18:48:05 user nova-compute[75634]:     </interface>
Nov 15 18:48:05 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:48:05 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48/console.log" append="off"/>
Nov 15 18:48:05 user nova-compute[75634]:     </serial>
Nov 15 18:48:05 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:48:05 user nova-compute[75634]:     <video>
Nov 15 18:48:05 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:48:05 user nova-compute[75634]:     </video>
Nov 15 18:48:05 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:48:05 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:48:05 user nova-compute[75634]:     </rng>
Nov 15 18:48:05 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:48:05 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:48:05 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:48:05 user nova-compute[75634]:     </memballoon>
Nov 15 18:48:05 user nova-compute[75634]:   </devices>
Nov 15 18:48:05 user nova-compute[75634]: </domain>
Nov 15 18:48:05 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG os_vif [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ccb9553-8b4e-518e-bdc3-9508b51feb7f', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b2f8a3e-2a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b2f8a3e-2a, col_values=(('qos', UUID('6e9e8836-b053-47da-962e-c809018e9e43')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b2f8a3e-2a, col_values=(('external_ids', {'iface-id': '3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:2b:88', 'vm-uuid': '6903a62f-7273-4616-9f37-a072c7e47c48'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:05 user nova-compute[75634]: INFO os_vif [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a')
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:5b:2b:88, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:48:06 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3535e09-0311-41cf-b9f7-c181174bd44f is timed out.
Nov 15 18:48:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully detached device vdb from instance c3535e09-0311-41cf-b9f7-c181174bd44f from the live domain config.
Nov 15 18:48:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbztLlQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:06 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9718a5c-2707-4135-9040-af089ad3ccfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:48:06 user nova-compute[75634]: No targets found.
Nov 15 18:48:06 user nova-compute[75634]: iSNS:
Nov 15 18:48:06 user nova-compute[75634]: No targets found.
Nov 15 18:48:06 user nova-compute[75634]: STATIC:
Nov 15 18:48:06 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:48:06 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:48:06 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:48:06 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5
Nov 15 18:48:06 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:48:06 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:48:06 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:48:06 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:48:06 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:48:06 user nova-compute[75634]: FIRMWARE:
Nov 15 18:48:06 user nova-compute[75634]: No targets found.
Nov 15 18:48:06 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:48:06 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:48:06 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e2e417-156f-4f4c-9664-7db65554d9de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b6c36-708e-4ae4-a0e3-356aeb730af2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:06 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:06 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:06 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:06 user nova-compute[75634]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 (non-flash)
Nov 15 18:48:06 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:06 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b79be0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d5952-cbdd-43d4-8d81-1d7dc0cab664]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6c173-57e1-46c7-9f02-30a778b83376]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[269db2cd-4d39-48c2-a09f-1ed89048a9ec]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c8ccd-2e24-47ff-ae53-08995adf7508]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[09acebe2-6820-472b-b9e6-540dc7113b3d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28c9a8-5b3b-41e9-b5d4-b3ddac2d0c4e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260]
Nov 15 18:48:06 user nova-compute[75634]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5, portal: 172.16.0.220,3260] successful.
Nov 15 18:48:06 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:773da2bc-a829-4453-994d-8b163b893eb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714435b-3acc-4408-950b-ef11ea2741ef]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] <== disconnect_volume: return (305ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:06 user nova-compute[75634]: WARNING nova.compute.manager [req-0238eae7-2c2b-4836-99f5-f38eb6064538 req-844c5670-d2ed-46e8-9f8a-a6670f6e2d9a service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state building and task_state spawning.
Nov 15 18:48:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:07 user nova-compute[75634]: DEBUG nova.objects.instance [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'flavor' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6f92da-2e61-4d11-b966-de5bfbfe6de2 tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:48:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance spawned successfully.
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:08 user nova-compute[75634]: INFO nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:08 user nova-compute[75634]: DEBUG nova.compute.manager [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:08 user nova-compute[75634]: WARNING nova.compute.manager [req-82767cd3-5028-4814-b892-4b20839d8ee3 req-7fe76a56-9a85-4c4e-a2fc-8bb8110b425e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state building and task_state spawning.
Nov 15 18:48:08 user nova-compute[75634]: INFO nova.compute.manager [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Took 10.74 seconds to build instance.
Nov 15 18:48:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0aa642c3-1cd5-40c4-8733-8cca91973be2 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.867s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing instance network info cache due to event network-changed-7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] Acquiring lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] Acquired lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Refreshing network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:16 user nova-compute[75634]: INFO nova.compute.manager [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Terminating instance
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-unplugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] No waiting events found dispatching network-vif-unplugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-5f51e7ca-9f24-4900-ba89-9a8c22849927 req-0a3905ba-7418-4968-bdf5-6c9529ecde88 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-unplugged-7c3fa923-7e34-4a58-a565-c8214f768996 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updated VIF entry in instance network info cache for port 7c3fa923-7e34-4a58-a565-c8214f768996. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [{"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28fbabe3-75a1-462e-854d-7609a93ed37a req-ff3a65f2-45b5-40cd-b390-52775128d8af service nova] Releasing lock "refresh_cache-2db80eba-1fb6-4671-b408-dc1acb70bc69" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Instance destroyed successfully.
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'resources' on Instance uuid 2db80eba-1fb6-4671-b408-dc1acb70bc69 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-111627372',display_name='tempest-TestStampPattern-server-111627372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-111627372',id=29,image_ref='459994c0-9b0f-4837-b848-1c101104180e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-qfmmy9tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e76c80e0-0538-428d-bd3c-07985d8205cc',image_min_disk='1',image_min_ram='0',image_owner_id='8eff43206fc5450ebe346f72798856f9',image_owner_project_name='tempest-TestStampPattern-326822497',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-326822497-project-member',image_user_id='d17a4320e9264810ba96eba3fcd707cf',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:45:34Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=2db80eba-1fb6-4671-b408-dc1acb70bc69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "7c3fa923-7e34-4a58-a565-c8214f768996", "address": "fa:16:3e:c6:e7:27", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c3fa923-7e", "ovs_interfaceid": "7c3fa923-7e34-4a58-a565-c8214f768996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG os_vif [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c3fa923-7e, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3b30207-adad-43c2-b3fa-a104fb62e774) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:17 user nova-compute[75634]: INFO os_vif [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:e7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c3fa923-7e34-4a58-a565-c8214f768996,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c3fa923-7e')
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Deleting instance files /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69_del
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Deletion of /opt/stack/data/nova/instances/2db80eba-1fb6-4671-b408-dc1acb70bc69_del complete
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.compute.manager [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 18:48:17 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Took 0.48 seconds to deallocate network for instance.
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-393e2d0b-cf2e-43f4-84d8-e9f823f86e05 req-e9bea7d8-c2bc-4340-8450-33685db2bfe4 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-deleted-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:17 user nova-compute[75634]: INFO nova.compute.manager [req-393e2d0b-cf2e-43f4-84d8-e9f823f86e05 req-e9bea7d8-c2bc-4340-8450-33685db2bfe4 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Neutron deleted interface 7c3fa923-7e34-4a58-a565-c8214f768996; detaching it from the instance and deleting it from the info cache
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.network.neutron [req-393e2d0b-cf2e-43f4-84d8-e9f823f86e05 req-e9bea7d8-c2bc-4340-8450-33685db2bfe4 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-393e2d0b-cf2e-43f4-84d8-e9f823f86e05 req-e9bea7d8-c2bc-4340-8450-33685db2bfe4 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Detach interface failed, port_id=7c3fa923-7e34-4a58-a565-c8214f768996, reason: Instance 2db80eba-1fb6-4671-b408-dc1acb70bc69 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:18 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Deleted allocations for instance 2db80eba-1fb6-4671-b408-dc1acb70bc69
Nov 15 18:48:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0649294-70aa-4dc7-a9ee-474c08c6dc63 tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] Acquiring lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] Lock "2db80eba-1fb6-4671-b408-dc1acb70bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] No waiting events found dispatching network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:18 user nova-compute[75634]: WARNING nova.compute.manager [req-a9451704-e05c-49d8-ba85-29696218f915 req-ba406c05-4b97-42a3-993c-ccfaf2c0da56 service nova] [instance: 2db80eba-1fb6-4671-b408-dc1acb70bc69] Received unexpected event network-vif-plugged-7c3fa923-7e34-4a58-a565-c8214f768996 for instance with vm_state deleted and task_state None.
Nov 15 18:48:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:48:22 user nova-compute[75634]: INFO nova.compute.claims [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Claim successful on node user
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:48:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.policy [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:48:23 user nova-compute[75634]: INFO nova.virt.block_device [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Booting with volume f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 at /dev/vda
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.utils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f21ec-fcf4-44e7-a65d-f53427d94510]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c833fb9-637b-4821-b0fa-13d5b581af92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34be2a9-1cb9-48e7-aa8a-ca66543bd198]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68c0a81-5564-4535-965a-4f928dc28738]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:23 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:48:23 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c3321f-be77-404e-8759-1ae6db044de6]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG os_brick.utils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:23 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updating existing volume attachment record: e82bdaf5-3bec-41ca-892a-d02f467a3a81 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Successfully created port: 6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Successfully updated port: 6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-changed-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Refreshing instance network info cache due to event network-changed-6260f948-41fc-4b14-aae3-778f3c9cdb1a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] Acquiring lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG nova.network.neutron [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updating instance_info_cache with network_info: [{"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Instance network_info: |[{"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] Acquired lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Refreshing network info cache for port 6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updated VIF entry in instance network info cache for port 6260f948-41fc-4b14-aae3-778f3c9cdb1a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updating instance_info_cache with network_info: [{"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5ba43400-a822-4de1-960b-26bc753c9a91 req-2721d6c9-e91a-4fce-91a6-d9b3daa820a0 service nova] Releasing lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:48:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:48:28 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Creating image(s)
Nov 15 18:48:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Ensure instance console log exists: /opt/stack/data/nova/instances/6d5895a2-9b07-44d1-8bb1-61290ac557e8/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:48:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Start _get_guest_xml network_info=[{"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzKSgDEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d5895a2-9b07-44d1-8bb1-61290ac557e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 'serial': 'f8f4087c-d48c-42d2-bf2d-cfa58cde12a7'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': 'e82bdaf5-3bec-41ca-892a-d02f467a3a81', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:48:29 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:29 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzKSgDEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:29 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:29 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:29 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2b9d8-cbc7-42b9-8daa-49c421b13206]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:48:29 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c2bce-801d-4c84-8f29-0d8709ad0b18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7] added
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51263c7-713b-41f7-93e8-c21a2d1c3cc1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[60814c7d-bc92-4182-969b-db32fbaccfb2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzKSgDEi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzKSgDEi" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306dcfe-f512-44d9-ba26-3e2ae5bc142c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AzKSgDEi'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d507bbdc-c009-4653-beb7-b244422cbf6a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e85725-5aee-486d-8296-f6101d075774]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba20f0-460a-46c8-ba50-c5db4720b6e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260]
Nov 15 18:48:29 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260] successful.
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[30edfdb5-114c-43ad-84f3-c323d2a77c65]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64e3cd-3225-4121-a982-51f7d628e495]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:29 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b72962-4040-423a-ab82-b68ad49a89ce]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzKSgDEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:30 user nova-compute[75634]: INFO nova.compute.manager [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Unrescuing
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26133643364343865', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133643364343865', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1823427555',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAR496uiDsFQpxThn1se9U2yq3qWt1EXzgEWMNpFAPrYJyocAiAzgtZLgMB4Kx3EkFbqa/uz/mjZ+cJWIVxvv2suYeBs4L3JALEpeo6wJJGaXBfggbUHuTWcR3USVIOLg==',key_name='tempest-keypair-1039034984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-t12q4myr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=6d5895a2-9b07-44d1-8bb1-61290ac557e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d5895a2-9b07-44d1-8bb1-61290ac557e8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:48:30 user nova-compute[75634]:   <uuid>6d5895a2-9b07-44d1-8bb1-61290ac557e8</uuid>
Nov 15 18:48:30 user nova-compute[75634]:   <name>instance-00000023</name>
Nov 15 18:48:30 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:48:30 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:48:30 user nova-compute[75634]:   <metadata>
Nov 15 18:48:30 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:48:30 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:48:30 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1823427555</nova:name>
Nov 15 18:48:30 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:48:29</nova:creationTime>
Nov 15 18:48:30 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:48:30 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:48:30 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:48:30 user nova-compute[75634]:       <nova:owner>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:48:30 user nova-compute[75634]:       </nova:owner>
Nov 15 18:48:30 user nova-compute[75634]:       <nova:ports>
Nov 15 18:48:30 user nova-compute[75634]:         <nova:port uuid="6260f948-41fc-4b14-aae3-778f3c9cdb1a">
Nov 15 18:48:30 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 18:48:30 user nova-compute[75634]:         </nova:port>
Nov 15 18:48:30 user nova-compute[75634]:       </nova:ports>
Nov 15 18:48:30 user nova-compute[75634]:     </nova:instance>
Nov 15 18:48:30 user nova-compute[75634]:   </metadata>
Nov 15 18:48:30 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:48:30 user nova-compute[75634]:     <system>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="serial">6d5895a2-9b07-44d1-8bb1-61290ac557e8</entry>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="uuid">6d5895a2-9b07-44d1-8bb1-61290ac557e8</entry>
Nov 15 18:48:30 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:48:30 user nova-compute[75634]:     </system>
Nov 15 18:48:30 user nova-compute[75634]:   </sysinfo>
Nov 15 18:48:30 user nova-compute[75634]:   <os>
Nov 15 18:48:30 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:48:30 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:48:30 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:48:30 user nova-compute[75634]:   </os>
Nov 15 18:48:30 user nova-compute[75634]:   <features>
Nov 15 18:48:30 user nova-compute[75634]:     <acpi/>
Nov 15 18:48:30 user nova-compute[75634]:     <apic/>
Nov 15 18:48:30 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:48:30 user nova-compute[75634]:   </features>
Nov 15 18:48:30 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:48:30 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:48:30 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:48:30 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:48:30 user nova-compute[75634]:   </clock>
Nov 15 18:48:30 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:48:30 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:48:30 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:48:30 user nova-compute[75634]:   </cpu>
Nov 15 18:48:30 user nova-compute[75634]:   <devices>
Nov 15 18:48:30 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:48:30 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:48:30 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:48:30 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:48:30 user nova-compute[75634]:       <serial>f8f4087c-d48c-42d2-bf2d-cfa58cde12a7</serial>
Nov 15 18:48:30 user nova-compute[75634]:     </disk>
Nov 15 18:48:30 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:48:30 user nova-compute[75634]:       <mac address="fa:16:3e:e0:44:1f"/>
Nov 15 18:48:30 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:48:30 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:48:30 user nova-compute[75634]:       <target dev="tap6260f948-41"/>
Nov 15 18:48:30 user nova-compute[75634]:     </interface>
Nov 15 18:48:30 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:48:30 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/6d5895a2-9b07-44d1-8bb1-61290ac557e8/console.log" append="off"/>
Nov 15 18:48:30 user nova-compute[75634]:     </serial>
Nov 15 18:48:30 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:48:30 user nova-compute[75634]:     <video>
Nov 15 18:48:30 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:48:30 user nova-compute[75634]:     </video>
Nov 15 18:48:30 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:48:30 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:48:30 user nova-compute[75634]:     </rng>
Nov 15 18:48:30 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:48:30 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:48:30 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:48:30 user nova-compute[75634]:     </memballoon>
Nov 15 18:48:30 user nova-compute[75634]:   </devices>
Nov 15 18:48:30 user nova-compute[75634]: </domain>
Nov 15 18:48:30 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1823427555',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAR496uiDsFQpxThn1se9U2yq3qWt1EXzgEWMNpFAPrYJyocAiAzgtZLgMB4Kx3EkFbqa/uz/mjZ+cJWIVxvv2suYeBs4L3JALEpeo6wJJGaXBfggbUHuTWcR3USVIOLg==',key_name='tempest-keypair-1039034984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-t12q4myr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=6d5895a2-9b07-44d1-8bb1-61290ac557e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG os_vif [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3eaabb54-5a22-5172-93a7-844af38f5350', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6260f948-41, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6260f948-41, col_values=(('qos', UUID('b9ae4147-7939-4f6d-bab5-4e6341747663')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6260f948-41, col_values=(('external_ids', {'iface-id': '6260f948-41fc-4b14-aae3-778f3c9cdb1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:44:1f', 'vm-uuid': '6d5895a2-9b07-44d1-8bb1-61290ac557e8'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:30 user nova-compute[75634]: INFO os_vif [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41')
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:e0:44:1f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'flavor' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:31 user nova-compute[75634]: WARNING nova.compute.manager [req-8554f8cf-f224-4191-9966-4e60a5862110 req-786e11a6-9b19-4615-8ade-f9f51879a536 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:48:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:32 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance destroyed successfully.
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] No waiting events found dispatching network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.compute.manager [req-c9f4c37f-76f7-42f4-9a0e-a49ae3aef597 req-f7f67f21-db53-4e2e-9c87-912e2f5b53a9 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received unexpected event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a for instance with vm_state building and task_state spawning.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.compute.manager [req-52684aff-31f9-44f9-be6d-627c2252d26b req-70fd5a8b-f20a-4e89-9173-d69aab6ce66c service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] No waiting events found dispatching network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.compute.manager [req-d3d53b21-9328-4dcb-a303-dacefb3b57d1 req-68cc9d38-2c7e-4eb7-b35c-3b925f49e39b service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received unexpected event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a for instance with vm_state building and task_state spawning.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.compute.manager [req-f4462a18-15f0-4b69-8f19-a59da305f595 req-fb6eaec5-109e-438c-b1e9-726ea2f942c4 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-714b6bbb-52ec-4318-bd40-30a58572ec1d tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=6920MB free_disk=24.83026885986328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Instance spawned successfully.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:48:36 user nova-compute[75634]: INFO nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Took 7.73 seconds to spawn the instance on the hypervisor.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e76c80e0-0538-428d-bd3c-07985d8205cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c3535e09-0311-41cf-b9f7-c181174bd44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 615fab46-3173-4f68-b938-c88142b8836a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance bda9b595-42d5-4483-8083-32882fd6eab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance c9581bab-c679-4d43-8e8b-8cc445c22060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:48:36 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:48:36 user nova-compute[75634]: INFO nova.compute.manager [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Took 13.95 seconds to build instance.
Nov 15 18:48:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7a58aa4c-7b62-4652-a7cd-0dd714122a3d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.041s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.objects.instance [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:37 user nova-compute[75634]: INFO nova.compute.manager [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attaching volume c5997922-6efb-4389-ae1a-461abc20891f to /dev/vdb
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.utils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[30822bea-6faf-4d33-870f-f7ac5a1da2b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87774a6-235c-428d-b324-42cceb9dedaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ece22-3d11-4333-bd1d-7abd5a3ec7b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786b48e-3042-4b85-8b2f-ec4638f32e5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:37 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619f558-a028-4727-852b-72f20f4a8b37]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG os_brick.utils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating existing volume attachment record: e29e84a1-cb1b-46ed-b24d-99ff55b255d2 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-changed-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Refreshing instance network info cache due to event network-changed-48640e4b-6a0a-4533-a947-5f9f89d26f1d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] Acquiring lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] Acquired lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:37 user nova-compute[75634]: DEBUG nova.network.neutron [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Refreshing network info cache for port 48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updated VIF entry in instance network info cache for port 48640e4b-6a0a-4533-a947-5f9f89d26f1d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating instance_info_cache with network_info: [{"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:38 user nova-compute[75634]: INFO nova.compute.manager [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Attaching volume e66841c8-9dc0-47b8-855e-6e1d823060ad to /dev/vdb
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1d56b3b9-a098-412b-8a8c-ae0404bc5628 req-a4f493ec-5a66-4f50-8f97-956235484fa4 service nova] Releasing lock "refresh_cache-615fab46-3173-4f68-b938-c88142b8836a" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.utils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9fbc09-c5db-4a33-b74c-0653c537bf6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7c461-2dc4-4fa7-9285-6f418f9435c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[165640f7-7587-4a3f-a1df-c99a1c9e8da3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c2ba0-6d3b-4b52-bee0-840d0a3b15a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:38 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:48:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f3632-98e0-4a6d-b4d8-aa6884df1c82]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG os_brick.utils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:38 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating existing volume attachment record: 912f080a-bbf1-47b9-8756-6b63edaa5c98 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [{"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-c3535e09-0311-41cf-b9f7-c181174bd44f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:48:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:48:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:43 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dfaf8f-8e3d-4582-81e5-f9c026c5b348]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:48:43 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff3662-c003-40d3-9ca0-db852c03e340]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad] added
Nov 15 18:48:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[83394af1-cad5-4d47-9120-c67dfef08426]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6df386c-726b-40dd-b218-77597c72def1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlanYuio {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlanYuio" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd30d5-0da4-45c8-b0a3-c8e92284b03b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlanYuio'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc7cf11-744c-4016-ac60-d03bb3c6922f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3c1dea-3b21-4937-bcc0-47d8a1acb484]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f85f1-1854-45e9-8955-8d394ff51dec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]
Nov 15 18:48:44 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.
Nov 15 18:48:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8625ff78-dea9-424c-8247-101cccc3004d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f100c99-57be-47da-baa7-5dbb6ab2f4a2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:44 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d227d34-cd46-49bf-9698-ba02fc071e22]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:48:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIMWUmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:45 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26533363332663034', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533363332663034', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.169s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:45 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:48:45 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[975bfa63-8317-42af-bfdf-f62888b8cc3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:48:45 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:48:45 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:48:45 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:48:45 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:48:45 user nova-compute[75634]:   <serial>e66841c8-9dc0-47b8-855e-6e1d823060ad</serial>
Nov 15 18:48:45 user nova-compute[75634]: </disk>
Nov 15 18:48:45 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[448cb1d2-fd9c-4777-85c4-cbb5a8ee9e34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f] added
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b9d14-9a4e-4dde-86b5-c33a7cbada66]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15483038-f2a8-4e86-a993-9aa6733158c5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnIMWUmL {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnIMWUmL" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1c73d-8c40-4193-9c58-1f1fc1193584]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnIMWUmL'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a10d30-eb60-4747-9b03-bd9f3d61278e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c83d9-4a38-4893-936d-bdd3eadd1ff7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6775fd-f529-4698-8105-f75c9bdbbbca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260]
Nov 15 18:48:45 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260] successful.
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f5676-7312-4e89-afdd-5ad1f21c6794]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bfdfd9-68b1-4ccf-ba4e-88a8719b2d7a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:48:45 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:48:45 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5885ba3-20a2-4492-97c6-3b88895dec34]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIMWUmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No VIF found with MAC fa:16:3e:ad:30:fe, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:48:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa44267c-138d-4d83-a3ed-b8ca4e1744f3 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.520s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23134646330343061', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134646330343061', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG nova.objects.instance [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:48:46 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:48:46 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:48:46 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:48:46 user nova-compute[75634]:   <serial>c5997922-6efb-4389-ae1a-461abc20891f</serial>
Nov 15 18:48:46 user nova-compute[75634]: </disk>
Nov 15 18:48:46 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:48:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:48:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No VIF found with MAC fa:16:3e:7d:22:e6, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:48:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-48ae0866-cb96-4dba-a111-eac7536f570d tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:51 user nova-compute[75634]: INFO nova.compute.manager [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attaching volume 4af22bfe-b3e2-4b05-b912-3131cff935c1 to /dev/vdc
Nov 15 18:48:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.utils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7df2d-fb16-4327-b7a6-053d73dcb13c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d70abe-688a-4439-b7e3-6bb183d52c7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86cb88d-8a76-4706-80a4-5ee55912a967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f0e23-ac79-4b79-8664-efc87a4d665e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:48:51 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea464a-38f4-483b-ad42-a4932e666c28]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG os_brick.utils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating existing volume attachment record: bcf66c44-de6e-482e-a999-7a4a0b2688c1 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing instance network info cache due to event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updated VIF entry in instance network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-eb844acf-60b7-4adb-bd3b-d96dbdc1ea8f req-f34366d5-4601-488a-8d48-f12768f89388 service nova] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing instance network info cache due to event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updated VIF entry in instance network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cfa32ad3-32bf-471a-8e23-19f415aeb7a7 req-0a0b13db-2d78-48af-aba9-f6ee1654d52d service nova] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:54 user nova-compute[75634]: INFO nova.compute.manager [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Terminating instance
Nov 15 18:48:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-unplugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] No waiting events found dispatching network-vif-unplugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-d44a9ebe-b9eb-463e-ada2-197f67322278 req-41a4f496-eac0-4a1a-a781-6e484d6937f5 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-unplugged-b7a2603a-84df-4520-b566-40a45cee4337 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:48:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Instance destroyed successfully.
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lazy-loading 'resources' on Instance uuid c3535e09-0311-41cf-b9f7-c181174bd44f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-15638943',display_name='tempest-SnapshotDataIntegrityTests-server-15638943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-15638943',id=22,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI65ipEb6a1VEm1DwhC/vVNwqYuRxq3GdpGYTi2M4CU81qkzcHmWv+K0zJAGWYTLSVc/wvpnEoV0aGcNOQXyyAL4shvvCR5sNaPP24pPyuGYnCEAIX/bRYCggXcMG6vv1A==',key_name='tempest-keypair-1202929257',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799f09d0a58c4138b5b95ce2516e7882',ramdisk_id='',reservation_id='r-rbzhyxk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-561763178',owner_user_name='tempest-SnapshotDataIntegrityTests-561763178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c762423a7fe4402d9dbab33db79a2430',uuid=c3535e09-0311-41cf-b9f7-c181174bd44f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converting VIF {"id": "b7a2603a-84df-4520-b566-40a45cee4337", "address": "fa:16:3e:5c:a4:b0", "network": {"id": "ff138a8f-5d70-458b-bfe9-ec3db766c7dd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276673042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799f09d0a58c4138b5b95ce2516e7882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a2603a-84", "ovs_interfaceid": "b7a2603a-84df-4520-b566-40a45cee4337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG os_vif [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7a2603a-84, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=354fe746-4ded-44db-ab2c-fdae14d39bb8) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:48:55 user nova-compute[75634]: INFO os_vif [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7a2603a-84df-4520-b566-40a45cee4337,network=Network(ff138a8f-5d70-458b-bfe9-ec3db766c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a2603a-84')
Nov 15 18:48:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Deleting instance files /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f_del
Nov 15 18:48:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Deletion of /opt/stack/data/nova/instances/c3535e09-0311-41cf-b9f7-c181174bd44f_del complete
Nov 15 18:48:55 user nova-compute[75634]: INFO nova.compute.manager [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 18:48:55 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:48:55 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-3cecdebe-dbb0-41ef-a367-7e996be785a4 req-fac39659-d74d-4666-82ce-945c32634bb8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-deleted-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:56 user nova-compute[75634]: INFO nova.compute.manager [req-3cecdebe-dbb0-41ef-a367-7e996be785a4 req-fac39659-d74d-4666-82ce-945c32634bb8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Neutron deleted interface b7a2603a-84df-4520-b566-40a45cee4337; detaching it from the instance and deleting it from the info cache
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.network.neutron [req-3cecdebe-dbb0-41ef-a367-7e996be785a4 req-fac39659-d74d-4666-82ce-945c32634bb8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:56 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Took 0.67 seconds to deallocate network for instance.
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-3cecdebe-dbb0-41ef-a367-7e996be785a4 req-fac39659-d74d-4666-82ce-945c32634bb8 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Detach interface failed, port_id=b7a2603a-84df-4520-b566-40a45cee4337, reason: Instance c3535e09-0311-41cf-b9f7-c181174bd44f could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:48:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:57 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Deleted allocations for instance c3535e09-0311-41cf-b9f7-c181174bd44f
Nov 15 18:48:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1785d506-5557-49cf-8f6b-3d6d0ec6b7cc tempest-SnapshotDataIntegrityTests-561763178 tempest-SnapshotDataIntegrityTests-561763178-project-member] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.208s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] Acquiring lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] Lock "c3535e09-0311-41cf-b9f7-c181174bd44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] No waiting events found dispatching network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:57 user nova-compute[75634]: WARNING nova.compute.manager [req-11df760f-62d0-40a8-8736-ee4b86136d70 req-e3be3513-3d1f-4dd4-a322-76b8d76232c4 service nova] [instance: c3535e09-0311-41cf-b9f7-c181174bd44f] Received unexpected event network-vif-plugged-b7a2603a-84df-4520-b566-40a45cee4337 for instance with vm_state deleted and task_state None.
Nov 15 18:48:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:58 user nova-compute[75634]: INFO nova.compute.manager [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Rebooting instance
Nov 15 18:48:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:48:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:48:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:48:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:48:59 user nova-compute[75634]: WARNING nova.compute.manager [req-6173b7c1-ccab-4cc2-8e89-85dc0ab0926c req-4a27b600-c144-4084-b581-54b40a54cfe9 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state active and task_state reboot_started_hard.
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance destroyed successfully.
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'resources' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:49:00Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dbbb306-50, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=416ec50f-e665-47bf-b68b-42eacf583828) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:00 user nova-compute[75634]: INFO os_vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50')
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:00 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[33270dbd-5a22-4dab-8c93-83daade28f1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:49:00 user nova-compute[75634]: No targets found.
Nov 15 18:49:00 user nova-compute[75634]: iSNS:
Nov 15 18:49:00 user nova-compute[75634]: No targets found.
Nov 15 18:49:00 user nova-compute[75634]: STATIC:
Nov 15 18:49:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:49:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:49:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:49:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:49:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:49:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:00 user nova-compute[75634]: FIRMWARE:
Nov 15 18:49:00 user nova-compute[75634]: No targets found.
Nov 15 18:49:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:49:00 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:49:00 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b60a34-1072-49a5-98d9-31bea4bd6daf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e1836-d75c-46f2-878b-82935d25afa3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:00 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b78fece50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba51d7f-b810-473f-b9af-1f9228739549]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dbd59f-1402-4440-832e-018abb3639b9]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e31cfeb-556f-47b4-acf0-cca5e4312182]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa597c6-98f3-4385-84b9-fde62361e0de]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7929f-8b3e-4cb1-9805-1b618edc3466]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71bdee7-3091-479a-bb08-18b6947d0b24]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]
Nov 15 18:49:00 user nova-compute[75634]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c6055-0f84-4d63-93b9-d3fa1f4ab74c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== disconnect_volume: return (325ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start _get_guest_xml network_info=[{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6f1e808b-e222-4001-924b-60dcfac9da06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '6f1e808b-e222-4001-924b-60dcfac9da06'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f89d2edf-0b80-484f-9176-76a0bf07d6d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e66841c8-9dc0-47b8-855e-6e1d823060ad', 'serial': 'e66841c8-9dc0-47b8-855e-6e1d823060ad'}, 'guest_format': None, 'boot_index': None, 'attachment_id': '912f080a-bbf1-47b9-8756-6b63edaa5c98', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:49:00 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:00 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6f1e808b-e222-4001-924b-60dcfac9da06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'vcpu_model' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.objects.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Object Instance<f89d2edf-0b80-484f-9176-76a0bf07d6d4> lazy-loaded attributes: resources,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:00 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:00 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:00 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ee0ab-87e0-400b-b4fc-200b4fbfe905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:49:00 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d68eeac-9ba0-48f2-8cea-b21f24aa19f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad] added
Nov 15 18:49:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c278ee6-8dc9-4f01-a270-1ad5abcb0e52]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180283b-27d0-451f-bdd1-660cfd2c0680]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlanYuio {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlanYuio" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa52f162-49c5-44c8-86ea-31c0e92f9d1f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlanYuio'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb04ff1-2ebb-41e7-b10c-6e354cf3e6ed]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5d6f3-8cf4-41f3-91b3-0dcfc6bf515a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0804b1-ca01-4c8e-bdc8-6e164c9ee5b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]
Nov 15 18:49:01 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da37b22-7a8c-4fa4-a930-e1f8c03127fd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd9a95-56e7-46b1-afd6-56a5b6461cc6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:01 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[12472185-98de-492b-a5a5-82a1c2a552d8]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfsFwncX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:01 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:02 user nova-compute[75634]: WARNING nova.compute.manager [req-2744613d-884b-43d8-905e-3bfeb91ce34c req-5051326f-be8e-40b1-aeb4-44e307aaf78e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state active and task_state reboot_started_hard.
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26533363332663034', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533363332663034', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.836s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:02 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:02 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a669ca-6469-466b-82c0-37e7e22502aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:49:02 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8da781-ae50-4b85-b856-cf9d43be3a78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1] added
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[18006f55-b7e3-4c96-aa94-5eb57c9c271d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:49:00Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.objects.instance [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'pci_devices' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c968cf-5c87-4cf0-9ab8-496f769a8ae4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfsFwncX {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.objects.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Object Instance<f89d2edf-0b80-484f-9176-76a0bf07d6d4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:49:02 user nova-compute[75634]:   <uuid>f89d2edf-0b80-484f-9176-76a0bf07d6d4</uuid>
Nov 15 18:49:02 user nova-compute[75634]:   <name>instance-0000001f</name>
Nov 15 18:49:02 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:49:02 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:49:02 user nova-compute[75634]:   <metadata>
Nov 15 18:49:02 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:49:02 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:name>tempest-TestMinimumBasicScenario-server-1410239741</nova:name>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:49:00</nova:creationTime>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:49:02 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:49:02 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:owner>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:user uuid="cfa5c40718134a13a514c8a165b42ab3">tempest-TestMinimumBasicScenario-547369327-project-member</nova:user>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:project uuid="247be554293e4d36a923272a63270742">tempest-TestMinimumBasicScenario-547369327</nova:project>
Nov 15 18:49:02 user nova-compute[75634]:       </nova:owner>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:root type="image" uuid="6f1e808b-e222-4001-924b-60dcfac9da06"/>
Nov 15 18:49:02 user nova-compute[75634]:       <nova:ports>
Nov 15 18:49:02 user nova-compute[75634]:         <nova:port uuid="4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed">
Nov 15 18:49:02 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:49:02 user nova-compute[75634]:         </nova:port>
Nov 15 18:49:02 user nova-compute[75634]:       </nova:ports>
Nov 15 18:49:02 user nova-compute[75634]:     </nova:instance>
Nov 15 18:49:02 user nova-compute[75634]:   </metadata>
Nov 15 18:49:02 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:49:02 user nova-compute[75634]:     <system>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="serial">f89d2edf-0b80-484f-9176-76a0bf07d6d4</entry>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="uuid">f89d2edf-0b80-484f-9176-76a0bf07d6d4</entry>
Nov 15 18:49:02 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:49:02 user nova-compute[75634]:     </system>
Nov 15 18:49:02 user nova-compute[75634]:   </sysinfo>
Nov 15 18:49:02 user nova-compute[75634]:   <os>
Nov 15 18:49:02 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:49:02 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:49:02 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:49:02 user nova-compute[75634]:   </os>
Nov 15 18:49:02 user nova-compute[75634]:   <features>
Nov 15 18:49:02 user nova-compute[75634]:     <acpi/>
Nov 15 18:49:02 user nova-compute[75634]:     <apic/>
Nov 15 18:49:02 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:49:02 user nova-compute[75634]:   </features>
Nov 15 18:49:02 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:49:02 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:49:02 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:49:02 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:49:02 user nova-compute[75634]:   </clock>
Nov 15 18:49:02 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:49:02 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:49:02 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:49:02 user nova-compute[75634]:   </cpu>
Nov 15 18:49:02 user nova-compute[75634]:   <devices>
Nov 15 18:49:02 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:49:02 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:49:02 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk"/>
Nov 15 18:49:02 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:49:02 user nova-compute[75634]:     </disk>
Nov 15 18:49:02 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:49:02 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:02 user nova-compute[75634]:       <source dev="/dev/sde"/>
Nov 15 18:49:02 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:49:02 user nova-compute[75634]:       <serial>e66841c8-9dc0-47b8-855e-6e1d823060ad</serial>
Nov 15 18:49:02 user nova-compute[75634]:     </disk>
Nov 15 18:49:02 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:49:02 user nova-compute[75634]:       <mac address="fa:16:3e:ad:30:fe"/>
Nov 15 18:49:02 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:49:02 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:49:02 user nova-compute[75634]:       <target dev="tap4dbbb306-50"/>
Nov 15 18:49:02 user nova-compute[75634]:     </interface>
Nov 15 18:49:02 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:49:02 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/console.log" append="off"/>
Nov 15 18:49:02 user nova-compute[75634]:     </serial>
Nov 15 18:49:02 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:49:02 user nova-compute[75634]:     <video>
Nov 15 18:49:02 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:49:02 user nova-compute[75634]:     </video>
Nov 15 18:49:02 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:49:02 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:49:02 user nova-compute[75634]:     </rng>
Nov 15 18:49:02 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:49:02 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:49:02 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:49:02 user nova-compute[75634]:     </memballoon>
Nov 15 18:49:02 user nova-compute[75634]:   </devices>
Nov 15 18:49:02 user nova-compute[75634]: </domain>
Nov 15 18:49:02 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfsFwncX" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0adae-a76d-4464-afee-a714976d0392]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfsFwncX'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0310b3-d4fd-4416-9f65-b21aa091939c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91dd3a7-5491-4bdc-89ff-841df8e7ef84]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8e1b8-0cb8-4aba-b66c-8f0f128f121a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260]
Nov 15 18:49:02 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431f4c5-423e-4ba6-b97f-dc182290a038]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[634cacf0-1a69-4449-aeab-0875ecb87834]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:02 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f0f9b-0c9f-4ddc-9c2d-b2d612c14920]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.objects.instance [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'trusted_certs' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG nova.objects.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Object Instance<f89d2edf-0b80-484f-9176-76a0bf07d6d4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-changed-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Refreshing instance network info cache due to event network-changed-091c0f10-632e-4b00-b25f-b9e1ab99c33f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] Acquiring lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] Acquired lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Refreshing network info cache for port 091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Cannot resize image /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.objects.instance [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'migration_context' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.objects.base [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Object Instance<f89d2edf-0b80-484f-9176-76a0bf07d6d4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:49:00Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG os_vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ceac5e-c71c-599b-ad35-cea80740b7a1', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dbbb306-50, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dbbb306-50, col_values=(('qos', UUID('3862cdf8-d53a-4e2b-8cf0-51cfd19ee37c')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dbbb306-50, col_values=(('external_ids', {'iface-id': '4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:30:fe', 'vm-uuid': 'f89d2edf-0b80-484f-9176-76a0bf07d6d4'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:03 user nova-compute[75634]: INFO os_vif [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50')
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updated VIF entry in instance network info cache for port 091c0f10-632e-4b00-b25f-b9e1ab99c33f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updating instance_info_cache with network_info: [{"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e4e1479d-3c43-4dbe-af58-bcf9bac89807 req-e1eeaa7f-cd36-489e-b2f4-12179f936fa1 service nova] Releasing lock "refresh_cache-bda9b595-42d5-4483-8083-32882fd6eab3" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfsFwncX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.534s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== connect_volume: return (2371ms) {'type': 'block', 'scsi_wwn': '23334326632393732', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334326632393732', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:49:03 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:03 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:49:03 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 18:49:03 user nova-compute[75634]:   <serial>4af22bfe-b3e2-4b05-b912-3131cff935c1</serial>
Nov 15 18:49:03 user nova-compute[75634]: </disk>
Nov 15 18:49:03 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] No VIF found with MAC fa:16:3e:7d:22:e6, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9d52525e-f072-40e7-aa8a-c7eb16008540 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.166s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:05 user nova-compute[75634]: INFO nova.compute.manager [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Attaching volume 7c7ce041-74fb-405d-a235-356b8705a87f to /dev/vdb
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.utils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c6a7a8-7a48-492a-b1eb-8f797fa115a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06d032-bd86-4121-8226-216fb5c1e207]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da2ac6-4622-481c-857b-1c53bed91d7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0956beb4-a353-4f6e-98c2-9a49a25ada0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:05 user nova-compute[75634]: WARNING nova.compute.manager [req-d2515a9f-1275-486d-97b4-d70c3bcaa72f req-56a7a978-22c2-4b2e-af9d-ac4e4d7faaa6 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state active and task_state reboot_started_hard.
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:49:05 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ff42c9-2666-49dc-9331-24c32d7dd48f]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG os_brick.utils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updating existing volume attachment record: 0d3d37a8-9b86-493f-8b44-52d586568c75 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:05 user nova-compute[75634]: INFO nova.compute.manager [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Detaching volume 4af22bfe-b3e2-4b05-b912-3131cff935c1
Nov 15 18:49:05 user nova-compute[75634]: INFO nova.virt.block_device [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attempting to driver detach volume 4af22bfe-b3e2-4b05-b912-3131cff935c1 from mountpoint /dev/vdc
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Attempting to detach device vdc from instance 615fab46-3173-4f68-b938-c88142b8836a from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:05 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:05 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:49:05 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 18:49:05 user nova-compute[75634]:   <serial>4af22bfe-b3e2-4b05-b912-3131cff935c1</serial>
Nov 15 18:49:05 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 18:49:05 user nova-compute[75634]: </disk>
Nov 15 18:49:05 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully detached device vdc from instance 615fab46-3173-4f68-b938-c88142b8836a from the persistent domain config.
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 615fab46-3173-4f68-b938-c88142b8836a from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:49:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:05 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:05 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:49:05 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 18:49:05 user nova-compute[75634]:   <serial>4af22bfe-b3e2-4b05-b912-3131cff935c1</serial>
Nov 15 18:49:05 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 18:49:05 user nova-compute[75634]: </disk>
Nov 15 18:49:05 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:49:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance rebooted successfully.
Nov 15 18:49:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:07 user nova-compute[75634]: WARNING nova.compute.manager [req-79c90023-4eec-4473-bd41-8b42785cdcac req-e9985599-bb7f-42fa-a538-27c5875c94d4 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state active and task_state reboot_started_hard.
Nov 15 18:49:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-aba8bd59-6fff-42af-82ca-01c3cc455ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.741s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbyhfCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:13 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce9b43-3485-4360-acd3-166de999af9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:49:13 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee7499-0acd-48f0-b047-a368b77b8d84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f] added
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b12768d-5b1a-4e64-b3e4-4471e701825b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d7977-4e25-4393-8bce-60e813dbc50b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbyhfCU {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbyhfCU" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b35b0-19a9-44e4-bab3-1b0d80df491e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnbyhfCU'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c76824-671d-4d68-ad0d-33401a1069c2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[97311eca-7181-497b-b6b9-82c178fb369d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d96f1-e5cc-4c97-b470-2b8631740fbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260]
Nov 15 18:49:13 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44217f9-f931-4088-b7a2-9f56e2822b0a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf81d1-ea91-4aed-950a-92a048d769ff]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:13 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] HCTL ('39', '-', '-', 0) found on session 45 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63b9abb-3455-4f8d-8b96-c7c5a5dc27c8]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching for a device in session 45 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:49:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbyhfCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:49:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23237623336393637', 'path': '/dev/sdh'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237623336393637', 'path': '/dev/sdh'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:49:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:49:14 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:14 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:49:14 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:49:14 user nova-compute[75634]:   <serial>7c7ce041-74fb-405d-a235-356b8705a87f</serial>
Nov 15 18:49:14 user nova-compute[75634]: </disk>
Nov 15 18:49:14 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:49:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:a8:9a:65, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:49:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-93b0804a-e994-448c-9ede-766508c3b4c1 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.159s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:16 user nova-compute[75634]: INFO nova.compute.manager [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Detaching volume 7c7ce041-74fb-405d-a235-356b8705a87f
Nov 15 18:49:16 user nova-compute[75634]: INFO nova.virt.block_device [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Attempting to driver detach volume 7c7ce041-74fb-405d-a235-356b8705a87f from mountpoint /dev/vdb
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Attempting to detach device vdb from instance bda9b595-42d5-4483-8083-32882fd6eab3 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:16 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:16 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:49:16 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:49:16 user nova-compute[75634]:   <serial>7c7ce041-74fb-405d-a235-356b8705a87f</serial>
Nov 15 18:49:16 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:49:16 user nova-compute[75634]: </disk>
Nov 15 18:49:16 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance bda9b595-42d5-4483-8083-32882fd6eab3 from the persistent domain config.
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bda9b595-42d5-4483-8083-32882fd6eab3 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:16 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:16 user nova-compute[75634]:   <source dev="/dev/sdh"/>
Nov 15 18:49:16 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:49:16 user nova-compute[75634]:   <serial>7c7ce041-74fb-405d-a235-356b8705a87f</serial>
Nov 15 18:49:16 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:49:16 user nova-compute[75634]: </disk>
Nov 15 18:49:16 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing instance network info cache due to event network-changed-375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] Acquiring lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] Acquired lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Refreshing network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:16 user nova-compute[75634]: INFO nova.compute.manager [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Terminating instance
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:49:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-unplugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] No waiting events found dispatching network-vif-unplugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-8c776274-0e0f-4503-b6e4-f7f020582a42 req-7e0feba5-9d19-4920-9e36-c1e85d87bb0c service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-unplugged-375588ad-c15b-41ec-8f04-6d08236bbcfe for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updated VIF entry in instance network info cache for port 375588ad-c15b-41ec-8f04-6d08236bbcfe. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [{"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ada1f81-8339-4612-8fdf-b9f85b1627e3 req-7f7cc903-1f11-4acf-b1da-0c213ef7b57e service nova] Releasing lock "refresh_cache-e76c80e0-0538-428d-bd3c-07985d8205cc" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Instance destroyed successfully.
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lazy-loading 'resources' on Instance uuid e76c80e0-0538-428d-bd3c-07985d8205cc {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1678264282',display_name='tempest-TestStampPattern-server-1678264282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1678264282',id=21,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHIW7bil5xd41cmXFFgd6M1+mJYG7AldUbcN/5ApYZgEkCJgHB4ONicKwrzh3ueh5VhsAsq45KKtLMoM2K8M9gRRiV1RM6Oa9+Z2aPtQoGjfABUnG7qg5RCep1cL5Vtow==',key_name='tempest-TestStampPattern-1721985030',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eff43206fc5450ebe346f72798856f9',ramdisk_id='',reservation_id='r-pdog9ym3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-326822497',owner_user_name='tempest-TestStampPattern-326822497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:45:21Z,user_data=None,user_id='d17a4320e9264810ba96eba3fcd707cf',uuid=e76c80e0-0538-428d-bd3c-07985d8205cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converting VIF {"id": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "address": "fa:16:3e:93:dc:1d", "network": {"id": "0eb5a388-3425-46d1-b220-52e0fa3b9331", "bridge": "br-int", "label": "tempest-TestStampPattern-96234050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eff43206fc5450ebe346f72798856f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375588ad-c1", "ovs_interfaceid": "375588ad-c15b-41ec-8f04-6d08236bbcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG os_vif [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap375588ad-c1, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b43ee9ae-28f0-4dc9-890d-d61fedeb4a4e) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:17 user nova-compute[75634]: INFO os_vif [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:dc:1d,bridge_name='br-int',has_traffic_filtering=True,id=375588ad-c15b-41ec-8f04-6d08236bbcfe,network=Network(0eb5a388-3425-46d1-b220-52e0fa3b9331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375588ad-c1')
Nov 15 18:49:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Deleting instance files /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc_del
Nov 15 18:49:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Deletion of /opt/stack/data/nova/instances/e76c80e0-0538-428d-bd3c-07985d8205cc_del complete
Nov 15 18:49:18 user nova-compute[75634]: INFO nova.compute.manager [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 18:49:18 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:49:18 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:49:18 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:49:18 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:18 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Took 0.40 seconds to deallocate network for instance.
Nov 15 18:49:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:18 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:19 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Deleted allocations for instance e76c80e0-0538-428d-bd3c-07985d8205cc
Nov 15 18:49:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2eb1eeef-532d-462d-9aba-d58fc5f48e9b tempest-TestStampPattern-326822497 tempest-TestStampPattern-326822497-project-member] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] Acquiring lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] Lock "e76c80e0-0538-428d-bd3c-07985d8205cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.034s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] No waiting events found dispatching network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:19 user nova-compute[75634]: WARNING nova.compute.manager [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received unexpected event network-vif-plugged-375588ad-c15b-41ec-8f04-6d08236bbcfe for instance with vm_state deleted and task_state None.
Nov 15 18:49:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e6ecb6d-9b32-463d-9606-0c49887b6bf5 req-ad94a07e-90f6-4104-88be-adf89385d3ff service nova] [instance: e76c80e0-0538-428d-bd3c-07985d8205cc] Received event network-vif-deleted-375588ad-c15b-41ec-8f04-6d08236bbcfe {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:26 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 615fab46-3173-4f68-b938-c88142b8836a is timed out.
Nov 15 18:49:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully detached device vdc from instance 615fab46-3173-4f68-b938-c88142b8836a from the live domain config.
Nov 15 18:49:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfsFwncX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:26 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823475e-8e32-4b6f-946e-e50584001e7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:49:26 user nova-compute[75634]: No targets found.
Nov 15 18:49:26 user nova-compute[75634]: iSNS:
Nov 15 18:49:26 user nova-compute[75634]: No targets found.
Nov 15 18:49:26 user nova-compute[75634]: STATIC:
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1
Nov 15 18:49:26 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:26 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:26 user nova-compute[75634]: FIRMWARE:
Nov 15 18:49:26 user nova-compute[75634]: No targets found.
Nov 15 18:49:26 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:49:26 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:49:26 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e392e-1719-4684-9821-6621c03736e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219f51b-be9b-42b0-b645-e59e5fe08d55]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:26 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 (non-flash)
Nov 15 18:49:26 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:26 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b681bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896f7dd-a212-462a-8ca9-d3353ffde1c7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[697af3c9-75d7-48f1-9865-4b36353c1cd9]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9f99f-dda3-4fa9-b34d-13e4058ccc89]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a65aa-90f9-477b-9534-581198f672f2]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6504d9f9-ded1-46c2-932f-cb1d794a4344]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[36243cb5-7f49-48c6-8aa4-4a96ce6da6fb]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260]
Nov 15 18:49:26 user nova-compute[75634]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:26 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af22bfe-b3e2-4b05-b912-3131cff935c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4664b2f6-e33d-4a1d-a219-af0c67b0f111]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== disconnect_volume: return (310ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:49:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f8bfb43f-6132-4696-9083-0233975af3bd tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.675s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:29 user nova-compute[75634]: INFO nova.compute.manager [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Terminating instance
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG nova.compute.manager [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-0a20510c-02fc-41b7-8bde-3f8ef4415661 req-571b0521-40e3-4f56-a15f-27257c7a8b52 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-unplugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Instance destroyed successfully.
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lazy-loading 'resources' on Instance uuid c9581bab-c679-4d43-8e8b-8cc445c22060 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1273182834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1273182834',id=24,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDceSRZZYYGJAolOqq+Csa4e5/GlQE0ZUR3RKnZpRDfgvkR68Q6PJk82SbxBJYVuhYJRoZ4hP7JdRVYP9HSe31IA6Hk461NvXTGdxoEdeZxPmRd7RFCbzIMtSKNpJrt+sA==',key_name='tempest-keypair-1393165220',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:47:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38d2c43038b241429feffe23bbbf4f1d',ramdisk_id='',reservation_id='r-jikwyku8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1234122392',owner_user_name='tempest-AttachVolumeShelveTestJSON-1234122392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6642c8d206564bc5b510ce6ead09fc2c',uuid=c9581bab-c679-4d43-8e8b-8cc445c22060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converting VIF {"id": "bef57442-7b6f-4366-9270-099f4bd4698d", "address": "fa:16:3e:d2:ec:18", "network": {"id": "c5a40e09-08ce-4703-a298-d462b11c78fb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-787338691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d2c43038b241429feffe23bbbf4f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef57442-7b", "ovs_interfaceid": "bef57442-7b6f-4366-9270-099f4bd4698d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG os_vif [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef57442-7b, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ac1edce-27c0-4a34-99c0-7c15a3e4b695) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:30 user nova-compute[75634]: INFO os_vif [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ec:18,bridge_name='br-int',has_traffic_filtering=True,id=bef57442-7b6f-4366-9270-099f4bd4698d,network=Network(c5a40e09-08ce-4703-a298-d462b11c78fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef57442-7b')
Nov 15 18:49:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Deleting instance files /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060_del
Nov 15 18:49:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Deletion of /opt/stack/data/nova/instances/c9581bab-c679-4d43-8e8b-8cc445c22060_del complete
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:30 user nova-compute[75634]: INFO nova.compute.manager [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:31 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Took 0.76 seconds to deallocate network for instance.
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:31 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Deleted allocations for instance c9581bab-c679-4d43-8e8b-8cc445c22060
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] Acquiring lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] No waiting events found dispatching network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:32 user nova-compute[75634]: WARNING nova.compute.manager [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received unexpected event network-vif-plugged-bef57442-7b6f-4366-9270-099f4bd4698d for instance with vm_state deleted and task_state None.
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-3986ce2d-c381-4842-9094-743096928b40 req-c1b61304-7533-4b2f-86b9-e7da9ad03181 service nova] [instance: c9581bab-c679-4d43-8e8b-8cc445c22060] Received event network-vif-deleted-bef57442-7b6f-4366-9270-099f4bd4698d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c820e9-0885-4e16-98c4-4739dc412475 tempest-AttachVolumeShelveTestJSON-1234122392 tempest-AttachVolumeShelveTestJSON-1234122392-project-member] Lock "c9581bab-c679-4d43-8e8b-8cc445c22060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7181MB free_disk=24.96997833251953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 615fab46-3173-4f68-b938-c88142b8836a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance bda9b595-42d5-4483-8083-32882fd6eab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:49:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:49:33 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:49:33 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:49:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:49:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:49:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bda9b595-42d5-4483-8083-32882fd6eab3 is timed out.
Nov 15 18:49:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance bda9b595-42d5-4483-8083-32882fd6eab3 from the live domain config.
Nov 15 18:49:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbyhfCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba642287-80d1-4fc3-8e04-0ca796c827cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:49:37 user nova-compute[75634]: No targets found.
Nov 15 18:49:37 user nova-compute[75634]: iSNS:
Nov 15 18:49:37 user nova-compute[75634]: No targets found.
Nov 15 18:49:37 user nova-compute[75634]: STATIC:
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:49:37 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:37 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:37 user nova-compute[75634]: FIRMWARE:
Nov 15 18:49:37 user nova-compute[75634]: No targets found.
Nov 15 18:49:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:49:37 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:49:37 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4b54ea-b4ed-4985-a3d6-f68832c7bab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc59c4c7-85b9-46a2-ae91-c0bac97929d3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:37 user nova-compute[75634]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f (non-flash)
Nov 15 18:49:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68295cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f'): ({'sdh'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Removing single pathed devices sdh {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cc7cc-6c7a-4d2e-9af7-97889d15abe9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2471d56-2995-462a-bb13-282d592f14db]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flushing IO for device /dev/sdh {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bcb8e4-7f02-43cb-9c5a-7e68ad2fe62a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710f521-8fdb-426c-aa6d-55acedfc80be]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] SCSI volumes sdh have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a806ba98-30eb-4962-8427-5f815a2965a0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9cb089-e711-4868-a084-b2846d9100e7]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260]
Nov 15 18:49:37 user nova-compute[75634]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:37 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7ce041-74fb-405d-a235-356b8705a87f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f7d2c7-c2ec-4619-b48b-6dbb9616dc68]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== disconnect_volume: return (310ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:49:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-770824c4-bae3-4432-a75d-f9c340adaf7c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:48 user nova-compute[75634]: INFO nova.compute.manager [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Rescuing
Nov 15 18:49:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:49:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing instance network info cache due to event network-changed-32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Refreshing network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:50 user nova-compute[75634]: WARNING nova.compute.manager [req-78d2304b-7824-4c75-a477-0d027aab8253 req-4a761f3f-9ee2-41eb-832a-8384c82fdeb2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state active and task_state rescuing.
Nov 15 18:49:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance destroyed successfully.
Nov 15 18:49:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Attempting rescue
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:49:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Creating image(s)
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated VIF entry in instance network info cache for port 32c5d0ab-3ab1-4cee-90d7-22298c5e753d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c7b17744-1a92-495e-903a-69bca5d67cb7 req-db08eaf1-72b6-4831-b9f3-891b7a5bc552 service nova] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue" returned: 0 in 0.056s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'migration_context' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.base [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<dbc304fa-0f5f-44b9-9dca-8f39d59a157e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start _get_guest_xml network_info=[{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:70:08:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.base [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<dbc304fa-0f5f-44b9-9dca-8f39d59a157e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'numa_topology' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.base [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<dbc304fa-0f5f-44b9-9dca-8f39d59a157e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:50 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:50 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.base [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<dbc304fa-0f5f-44b9-9dca-8f39d59a157e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099763569',display_name='tempest-ServerRescueNegativeTestJSON-server-1099763569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099763569',id=26,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-s2hga7f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:45:15Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=dbc304fa-0f5f-44b9-9dca-8f39d59a157e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:70:08:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:70:08:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.instance [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.objects.base [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<dbc304fa-0f5f-44b9-9dca-8f39d59a157e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:49:50 user nova-compute[75634]:   <uuid>dbc304fa-0f5f-44b9-9dca-8f39d59a157e</uuid>
Nov 15 18:49:50 user nova-compute[75634]:   <name>instance-0000001a</name>
Nov 15 18:49:50 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:49:50 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:49:50 user nova-compute[75634]:   <metadata>
Nov 15 18:49:50 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:49:50 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1099763569</nova:name>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:49:50</nova:creationTime>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:49:50 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:49:50 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:owner>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:49:50 user nova-compute[75634]:       </nova:owner>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:49:50 user nova-compute[75634]:       <nova:ports>
Nov 15 18:49:50 user nova-compute[75634]:         <nova:port uuid="07777476-904a-462a-b52f-17f75c58f2ff">
Nov 15 18:49:50 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 18:49:50 user nova-compute[75634]:         </nova:port>
Nov 15 18:49:50 user nova-compute[75634]:       </nova:ports>
Nov 15 18:49:50 user nova-compute[75634]:     </nova:instance>
Nov 15 18:49:50 user nova-compute[75634]:   </metadata>
Nov 15 18:49:50 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:49:50 user nova-compute[75634]:     <system>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="serial">dbc304fa-0f5f-44b9-9dca-8f39d59a157e</entry>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="uuid">dbc304fa-0f5f-44b9-9dca-8f39d59a157e</entry>
Nov 15 18:49:50 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:49:50 user nova-compute[75634]:     </system>
Nov 15 18:49:50 user nova-compute[75634]:   </sysinfo>
Nov 15 18:49:50 user nova-compute[75634]:   <os>
Nov 15 18:49:50 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:49:50 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:49:50 user nova-compute[75634]:   </os>
Nov 15 18:49:50 user nova-compute[75634]:   <features>
Nov 15 18:49:50 user nova-compute[75634]:     <acpi/>
Nov 15 18:49:50 user nova-compute[75634]:     <apic/>
Nov 15 18:49:50 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:49:50 user nova-compute[75634]:   </features>
Nov 15 18:49:50 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:49:50 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:49:50 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:49:50 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:49:50 user nova-compute[75634]:   </clock>
Nov 15 18:49:50 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:49:50 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:49:50 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:49:50 user nova-compute[75634]:   </cpu>
Nov 15 18:49:50 user nova-compute[75634]:   <devices>
Nov 15 18:49:50 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:49:50 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:49:50 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue"/>
Nov 15 18:49:50 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:49:50 user nova-compute[75634]:     </disk>
Nov 15 18:49:50 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:49:50 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:49:50 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk"/>
Nov 15 18:49:50 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:49:50 user nova-compute[75634]:     </disk>
Nov 15 18:49:50 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:49:50 user nova-compute[75634]:       <mac address="fa:16:3e:70:08:ff"/>
Nov 15 18:49:50 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:49:50 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:49:50 user nova-compute[75634]:       <target dev="tap07777476-90"/>
Nov 15 18:49:50 user nova-compute[75634]:     </interface>
Nov 15 18:49:50 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:49:50 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/console.log" append="off"/>
Nov 15 18:49:50 user nova-compute[75634]:     </serial>
Nov 15 18:49:50 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:49:50 user nova-compute[75634]:     <video>
Nov 15 18:49:50 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:49:50 user nova-compute[75634]:     </video>
Nov 15 18:49:50 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:49:50 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:49:50 user nova-compute[75634]:     </rng>
Nov 15 18:49:50 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:49:50 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:49:50 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:49:50 user nova-compute[75634]:     </memballoon>
Nov 15 18:49:50 user nova-compute[75634]:   </devices>
Nov 15 18:49:50 user nova-compute[75634]: </domain>
Nov 15 18:49:50 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:49:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance destroyed successfully.
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:49:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:70:08:ff, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:49:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Stashing vm_state: active {{(pid=75634) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 18:49:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:51 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:49:51 user nova-compute[75634]: INFO nova.compute.claims [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Claim successful on node user
Nov 15 18:49:51 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating resource usage from migration 8b9fdb59-2405-46e0-8975-facc1167fd58
Nov 15 18:49:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-changed-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Refreshing instance network info cache due to event network-changed-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Refreshing network info cache for port 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:52 user nova-compute[75634]: WARNING nova.compute.manager [req-b6b021b3-36d8-48a1-ab7a-f44a9046d144 req-c6ff16d7-36d9-4a4c-8dfc-be33450c837c service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state active and task_state rescuing.
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.474s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:52 user nova-compute[75634]: INFO nova.compute.manager [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Migrating
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updated VIF entry in instance network info cache for port 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d073104b-436b-4f0c-ad8c-d5ce08ed5779 req-d0487934-5e61-472b-b4e7-32a1f29994df service nova] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:52 user nova-compute[75634]: DEBUG nova.network.neutron [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Starting migrate_disk_and_power_off {{(pid=75634) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:53 user nova-compute[75634]: WARNING nova.compute.manager [req-d0ae6983-c4ce-4a04-9c09-5391ed0bcbd2 req-b149eff3-ef10-4549-a2de-621edefad6e2 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state active and task_state resize_migrating.
Nov 15 18:49:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance destroyed successfully.
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b2f8a3e-2a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e9e8836-b053-47da-962e-c809018e9e43) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:54 user nova-compute[75634]: INFO os_vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a')
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:54 user nova-compute[75634]: WARNING nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state active and task_state rescuing.
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:54 user nova-compute[75634]: WARNING nova.compute.manager [req-2c8f919b-7f0b-47ee-8783-2365de6b3d12 req-36118c34-4e6a-46b4-85f7-a2b165692e68 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state active and task_state rescuing.
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:54 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[43639725-824b-424a-b528-2610ca5eb4ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:49:54 user nova-compute[75634]: No targets found.
Nov 15 18:49:54 user nova-compute[75634]: iSNS:
Nov 15 18:49:54 user nova-compute[75634]: No targets found.
Nov 15 18:49:54 user nova-compute[75634]: STATIC:
Nov 15 18:49:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:49:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:49:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:49:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:49:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:49:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:49:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:49:54 user nova-compute[75634]: FIRMWARE:
Nov 15 18:49:54 user nova-compute[75634]: No targets found.
Nov 15 18:49:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:49:54 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:49:54 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb322f7-0439-49b2-bd75-b287709a7409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509befe-4335-48d6-83c7-65e1fdd98de7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:49:54 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:49:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b684471c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb5c727-2818-4af3-9c62-b4e27fc49a61]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c42b29-ed88-4183-96e0-6433127520b3]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e812fe19-edf5-4458-bb7a-b9137a81f929]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[29acde57-774e-4824-8c1a-67803388dc4f]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_15399538', '/dev/disk/by-id/scsi-23763666661396564', '/dev/disk/by-id/scsi-1SCST_BIO15399538-7cffa9ed1fa71558') {{(pid=85900) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01ff60-b76a-41b8-afaa-dfac122f4721]: (4, None) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-47805fc6-71de-41e8-a8eb-5fe3ad8199bf tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35dd161-d534-4c95-a797-017b4b7cffc6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65080b15-feb7-46d2-83cf-df77b694d6f2]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]
Nov 15 18:49:54 user nova-compute[75634]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.
Nov 15 18:49:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ebd6c-552b-4517-af09-953def2d453b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== disconnect_volume: return (366ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:49:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Port 3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b binding to destination host user is already ACTIVE {{(pid=75634) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:49:55 user nova-compute[75634]: WARNING nova.compute.manager [req-0f134db1-ecc3-49a6-9649-eceed3808931 req-940262fc-c967-42fe-acb4-4b32b0f2ac38 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state active and task_state resize_migrating.
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:49:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:49:56 user nova-compute[75634]: INFO nova.compute.manager [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Detaching volume c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:49:56 user nova-compute[75634]: INFO nova.virt.block_device [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Attempting to driver detach volume c5997922-6efb-4389-ae1a-461abc20891f from mountpoint /dev/vdb
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Attempting to detach device vdb from instance 615fab46-3173-4f68-b938-c88142b8836a from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:56 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:56 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:49:56 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:49:56 user nova-compute[75634]:   <serial>c5997922-6efb-4389-ae1a-461abc20891f</serial>
Nov 15 18:49:56 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:49:56 user nova-compute[75634]: </disk>
Nov 15 18:49:56 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:49:56 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully detached device vdb from instance 615fab46-3173-4f68-b938-c88142b8836a from the persistent domain config.
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 615fab46-3173-4f68-b938-c88142b8836a from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:49:56 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:49:56 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:49:56 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:49:56 user nova-compute[75634]:   <serial>c5997922-6efb-4389-ae1a-461abc20891f</serial>
Nov 15 18:49:56 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:49:56 user nova-compute[75634]: </disk>
Nov 15 18:49:56 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.utils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[11343bc7-68a2-4969-b645-77f143da7cd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164d333-b514-43a2-a16b-61e0f0be25c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[256d26f9-a04a-4aae-8b35-a147342c319a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ba9a0-b27c-4933-b099-453cedc31386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:49:56 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:49:56 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6be17a-b374-4dcc-b7d4-e377a107f130]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG os_brick.utils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:49:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:49:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Starting finish_migration {{(pid=75634) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:50:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Creating image(s)
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Ensure instance console log exists: /opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start _get_guest_xml network_info=[{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6903a62f-7273-4616-9f37-a072c7e47c48', 'attached_at': '2023-11-15T18:50:02.000000', 'detached_at': '', 'volume_id': '05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'serial': '05e6d5f5-0f70-4f79-a6e8-44208773bbec'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '30b07e78-2df2-44b5-801b-a740eedd491d', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:50:01 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:01 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:50:01 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:50:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:50:01 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:50:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:50:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:50:01 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:50:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899a1a6-ce34-4013-b5d5-60264e97d09a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:50:02 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd8a8d6-f12a-40a4-9ad5-685d50d7e330]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec] added
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2907ce-b574-4896-b220-6cacaca66194]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1525b0-8eb2-4856-82af-f3ba08d4a5d3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syMdZPat {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syMdZPat" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[571cd464-0c78-42f0-9999-38b1ea34d137]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syMdZPat'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e826a1-bbf0-43c0-9099-5aacc01a3bd4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e77dd-1d06-4017-b815-c5aece758459]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[35064e16-0422-4767-a7f3-351b24b1d7ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]
Nov 15 18:50:02 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86f5e5e-189b-4651-b49f-4935cc8bb72b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[18409265-b728-4f55-96de-57c78958bb76]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:02 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:02 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d30270-b828-480d-a9ba-0f4e52041bd3]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:50:02 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23763666661396564', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763666661396564', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:50:03 user nova-compute[75634]:   <uuid>6903a62f-7273-4616-9f37-a072c7e47c48</uuid>
Nov 15 18:50:03 user nova-compute[75634]:   <name>instance-00000022</name>
Nov 15 18:50:03 user nova-compute[75634]:   <memory>2097152</memory>
Nov 15 18:50:03 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:50:03 user nova-compute[75634]:   <metadata>
Nov 15 18:50:03 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:50:03 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:50:03 user nova-compute[75634]:       <nova:name>tempest-ServerActionsTestOtherA-server-1783177436</nova:name>
Nov 15 18:50:03 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:50:01</nova:creationTime>
Nov 15 18:50:03 user nova-compute[75634]:       <nova:flavor name="m1.small">
Nov 15 18:50:03 user nova-compute[75634]:         <nova:memory>2048</nova:memory>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:disk>20</nova:disk>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:50:03 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:50:03 user nova-compute[75634]:       <nova:owner>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:user uuid="3ebb5c4075034b1482d50a9ff5dd990b">tempest-ServerActionsTestOtherA-1839012723-project-member</nova:user>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:project uuid="0fb5adcf609a4fd7a67d3574243cc920">tempest-ServerActionsTestOtherA-1839012723</nova:project>
Nov 15 18:50:03 user nova-compute[75634]:       </nova:owner>
Nov 15 18:50:03 user nova-compute[75634]:       <nova:ports>
Nov 15 18:50:03 user nova-compute[75634]:         <nova:port uuid="3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b">
Nov 15 18:50:03 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:50:03 user nova-compute[75634]:         </nova:port>
Nov 15 18:50:03 user nova-compute[75634]:       </nova:ports>
Nov 15 18:50:03 user nova-compute[75634]:     </nova:instance>
Nov 15 18:50:03 user nova-compute[75634]:   </metadata>
Nov 15 18:50:03 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:50:03 user nova-compute[75634]:     <system>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="serial">6903a62f-7273-4616-9f37-a072c7e47c48</entry>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="uuid">6903a62f-7273-4616-9f37-a072c7e47c48</entry>
Nov 15 18:50:03 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:50:03 user nova-compute[75634]:     </system>
Nov 15 18:50:03 user nova-compute[75634]:   </sysinfo>
Nov 15 18:50:03 user nova-compute[75634]:   <os>
Nov 15 18:50:03 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:50:03 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:50:03 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:50:03 user nova-compute[75634]:   </os>
Nov 15 18:50:03 user nova-compute[75634]:   <features>
Nov 15 18:50:03 user nova-compute[75634]:     <acpi/>
Nov 15 18:50:03 user nova-compute[75634]:     <apic/>
Nov 15 18:50:03 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:50:03 user nova-compute[75634]:   </features>
Nov 15 18:50:03 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:50:03 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:50:03 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:50:03 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:50:03 user nova-compute[75634]:   </clock>
Nov 15 18:50:03 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:50:03 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:50:03 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:50:03 user nova-compute[75634]:   </cpu>
Nov 15 18:50:03 user nova-compute[75634]:   <devices>
Nov 15 18:50:03 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:50:03 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:50:03 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:50:03 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:50:03 user nova-compute[75634]:       <serial>05e6d5f5-0f70-4f79-a6e8-44208773bbec</serial>
Nov 15 18:50:03 user nova-compute[75634]:     </disk>
Nov 15 18:50:03 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:50:03 user nova-compute[75634]:       <mac address="fa:16:3e:5b:2b:88"/>
Nov 15 18:50:03 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:03 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:50:03 user nova-compute[75634]:       <target dev="tap3b2f8a3e-2a"/>
Nov 15 18:50:03 user nova-compute[75634]:     </interface>
Nov 15 18:50:03 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:50:03 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48/console.log" append="off"/>
Nov 15 18:50:03 user nova-compute[75634]:     </serial>
Nov 15 18:50:03 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:50:03 user nova-compute[75634]:     <video>
Nov 15 18:50:03 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:03 user nova-compute[75634]:     </video>
Nov 15 18:50:03 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:50:03 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:50:03 user nova-compute[75634]:     </rng>
Nov 15 18:50:03 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:50:03 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:50:03 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:50:03 user nova-compute[75634]:     </memballoon>
Nov 15 18:50:03 user nova-compute[75634]:   </devices>
Nov 15 18:50:03 user nova-compute[75634]: </domain>
Nov 15 18:50:03 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1648297771-network", "vif_mac": "fa:16:3e:5b:2b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG os_vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ccb9553-8b4e-518e-bdc3-9508b51feb7f', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b2f8a3e-2a, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b2f8a3e-2a, col_values=(('qos', UUID('543e77c8-ca23-4c97-a490-d2a896c38f64')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b2f8a3e-2a, col_values=(('external_ids', {'iface-id': '3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:2b:88', 'vm-uuid': '6903a62f-7273-4616-9f37-a072c7e47c48'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:03 user nova-compute[75634]: INFO os_vif [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a')
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:50:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] No VIF found with MAC fa:16:3e:5b:2b:88, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:04 user nova-compute[75634]: WARNING nova.compute.manager [req-86e866c3-e2f2-41b7-a3da-d26b76f0985b req-a8ebedf1-5545-4772-bc2c-672e5433e1c3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state active and task_state resize_finish.
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:06 user nova-compute[75634]: INFO nova.compute.manager [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Terminating instance
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:50:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance running successfully.
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Failed to set time: agent not configured {{(pid=75634) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-74d09f8f-aa3f-49d1-b781-a3643207c32a tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] finish_migration finished successfully. {{(pid=75634) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:06 user nova-compute[75634]: WARNING nova.compute.manager [req-726d7795-9a14-4462-9e67-c4ca73b007d9 req-659a9307-2081-42a4-8563-44b0420fd3e3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state active and task_state resize_finish.
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-unplugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] No waiting events found dispatching network-vif-unplugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3cbd2b6-1aea-4e5a-9c7b-17aecefaac4c req-b39deb9b-8218-46cc-b8cb-a1a95baa196d service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-unplugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:50:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Instance destroyed successfully.
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'resources' on Instance uuid bda9b595-42d5-4483-8083-32882fd6eab3 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1178382398',display_name='tempest-AttachVolumeNegativeTest-server-1178382398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1178382398',id=33,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxIVjokPG/m+JiIYli0W5hDt/da7Kra/M7Z+nCaGN+na9j/uUwUoStV3spN322ktJYEa0Hx1QVnMiikoIaIi+ryrelMDZumwq+MVhM+9/RMMkkf8gIJkRz5y3NLGVKMaw==',key_name='tempest-keypair-1772097541',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-a4fot6w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=bda9b595-42d5-4483-8083-32882fd6eab3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "address": "fa:16:3e:a8:9a:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091c0f10-63", "ovs_interfaceid": "091c0f10-632e-4b00-b25f-b9e1ab99c33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG os_vif [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091c0f10-63, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=003a1360-d1dc-4f9a-9617-eb2256544122) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:07 user nova-compute[75634]: INFO os_vif [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:65,bridge_name='br-int',has_traffic_filtering=True,id=091c0f10-632e-4b00-b25f-b9e1ab99c33f,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091c0f10-63')
Nov 15 18:50:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Deleting instance files /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3_del
Nov 15 18:50:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Deletion of /opt/stack/data/nova/instances/bda9b595-42d5-4483-8083-32882fd6eab3_del complete
Nov 15 18:50:07 user nova-compute[75634]: INFO nova.compute.manager [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 18:50:07 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:50:07 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:50:08 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:08 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Took 0.80 seconds to deallocate network for instance.
Nov 15 18:50:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:08 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:08 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:08 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Deleted allocations for instance bda9b595-42d5-4483-8083-32882fd6eab3
Nov 15 18:50:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f7b9b77-dff8-4a89-8845-dd3565d688ac tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "bda9b595-42d5-4483-8083-32882fd6eab3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] Acquiring lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] Lock "bda9b595-42d5-4483-8083-32882fd6eab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] No waiting events found dispatching network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:09 user nova-compute[75634]: WARNING nova.compute.manager [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received unexpected event network-vif-plugged-091c0f10-632e-4b00-b25f-b9e1ab99c33f for instance with vm_state deleted and task_state None.
Nov 15 18:50:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-751eb62d-63fd-4f8c-8b3b-b5cf8030d70a req-61dac0b5-5cc3-4cad-a99e-2a1b10c7a0b5 service nova] [instance: bda9b595-42d5-4483-8083-32882fd6eab3] Received event network-vif-deleted-091c0f10-632e-4b00-b25f-b9e1ab99c33f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-changed-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Refreshing instance network info cache due to event network-changed-6260f948-41fc-4b14-aae3-778f3c9cdb1a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] Acquiring lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] Acquired lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:13 user nova-compute[75634]: DEBUG nova.network.neutron [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Refreshing network info cache for port 6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:14 user nova-compute[75634]: DEBUG nova.network.neutron [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updated VIF entry in instance network info cache for port 6260f948-41fc-4b14-aae3-778f3c9cdb1a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:14 user nova-compute[75634]: DEBUG nova.network.neutron [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updating instance_info_cache with network_info: [{"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3434a053-9abd-4f2e-aa3f-2cd97bc6191a req-1db7a0a1-38f2-4b13-8426-e211cbd77678 service nova] Releasing lock "refresh_cache-6d5895a2-9b07-44d1-8bb1-61290ac557e8" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:16 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 615fab46-3173-4f68-b938-c88142b8836a is timed out.
Nov 15 18:50:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully detached device vdb from instance 615fab46-3173-4f68-b938-c88142b8836a from the live domain config.
Nov 15 18:50:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:50:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIMWUmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:50:16 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:50:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:50:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b60f0-15c4-4768-b84c-ad105726d775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:50:17 user nova-compute[75634]: No targets found.
Nov 15 18:50:17 user nova-compute[75634]: iSNS:
Nov 15 18:50:17 user nova-compute[75634]: No targets found.
Nov 15 18:50:17 user nova-compute[75634]: STATIC:
Nov 15 18:50:17 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f
Nov 15 18:50:17 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:50:17 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:50:17 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:50:17 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:50:17 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:50:17 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:50:17 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:50:17 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:50:17 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:50:17 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:50:17 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:50:17 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:50:17 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:50:17 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:50:17 user nova-compute[75634]: FIRMWARE:
Nov 15 18:50:17 user nova-compute[75634]: No targets found.
Nov 15 18:50:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:50:17 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:50:17 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b5d0e-51f4-40fe-9ecd-4840a504d287]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6058cb5e-286f-434d-98d9-cffc94c0ccbf]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:17 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44119510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6242df3d-0743-4691-88de-326429eb15a4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6418d0a-6b30-43c2-ae38-6dad98b017bd]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f922c9-1b2c-425f-b55c-fd66c9cde964]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c196d18c-ad8d-4c52-a016-bcc059a1580c]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b46a9-4ba7-4025-8e75-38592de8167b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbd719-ad46-4d55-b283-e9e8237f6fb8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260]
Nov 15 18:50:17 user nova-compute[75634]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f, portal: 172.16.0.220,3260] successful.
Nov 15 18:50:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5997922-6efb-4389-ae1a-461abc20891f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d169df-b816-4b61-9852-cc7603eb9917]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] <== disconnect_volume: return (348ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:50:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:18 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'flavor' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3b4b1bd9-ab6f-4870-8e6b-b1b1e183e878 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:50:20 user nova-compute[75634]: INFO nova.compute.claims [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Claim successful on node user
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:50:20 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:50:20 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:50:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:50:21 user nova-compute[75634]: INFO nova.virt.block_device [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Booting with volume snapshot eae44bd8-8bcf-4ad3-9cb2-1e7a539920a6 at /dev/vda
Nov 15 18:50:21 user nova-compute[75634]: DEBUG nova.policy [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:50:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Successfully created port: c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:50:22 user nova-compute[75634]: INFO nova.compute.claims [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Claim successful on node user
Nov 15 18:50:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Successfully updated port: c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-changed-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Refreshing instance network info cache due to event network-changed-c50fa564-6b88-4526-aecb-22bbabfc0772. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] Acquiring lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updating instance_info_cache with network_info: [{"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Instance network_info: |[{"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] Acquired lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Refreshing network info cache for port c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:22 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:50:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.policy [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000d54e8a82d48b58f554ae085a4dab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17eb80780ad4231889417dab82ea2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:50:23 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Creating image(s)
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "/opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updated VIF entry in instance network info cache for port c50fa564-6b88-4526-aecb-22bbabfc0772. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updating instance_info_cache with network_info: [{"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-412d92fe-d788-44e7-9b13-ad02ecbee2d1 req-4c62497e-516a-4bc1-8837-c69c16db5130 service nova] Releasing lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk 1073741824" returned: 0 in 0.062s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Successfully created port: ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Cannot resize image /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Ensure instance console log exists: /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Successfully updated port: ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updating instance_info_cache with network_info: [{"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-changed-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Refreshing instance network info cache due to event network-changed-ca729026-e47e-4d10-affa-3e3b0c8a9faf. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] Acquiring lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Instance network_info: |[{"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] Acquired lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.neutron [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Refreshing network info cache for port ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Start _get_guest_xml network_info=[{"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:50:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:24 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1527921557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1527921557',id=37,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-l0f2a0h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:23Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=d324a863-5fde-4342-815f-da9a158d5df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.objects.instance [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid d324a863-5fde-4342-815f-da9a158d5df7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:50:24 user nova-compute[75634]:   <uuid>d324a863-5fde-4342-815f-da9a158d5df7</uuid>
Nov 15 18:50:24 user nova-compute[75634]:   <name>instance-00000025</name>
Nov 15 18:50:24 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:50:24 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:50:24 user nova-compute[75634]:   <metadata>
Nov 15 18:50:24 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:50:24 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1527921557</nova:name>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:50:24</nova:creationTime>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:50:24 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:50:24 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:owner>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:50:24 user nova-compute[75634]:       </nova:owner>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:50:24 user nova-compute[75634]:       <nova:ports>
Nov 15 18:50:24 user nova-compute[75634]:         <nova:port uuid="ca729026-e47e-4d10-affa-3e3b0c8a9faf">
Nov 15 18:50:24 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 18:50:24 user nova-compute[75634]:         </nova:port>
Nov 15 18:50:24 user nova-compute[75634]:       </nova:ports>
Nov 15 18:50:24 user nova-compute[75634]:     </nova:instance>
Nov 15 18:50:24 user nova-compute[75634]:   </metadata>
Nov 15 18:50:24 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:50:24 user nova-compute[75634]:     <system>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="serial">d324a863-5fde-4342-815f-da9a158d5df7</entry>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="uuid">d324a863-5fde-4342-815f-da9a158d5df7</entry>
Nov 15 18:50:24 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:50:24 user nova-compute[75634]:     </system>
Nov 15 18:50:24 user nova-compute[75634]:   </sysinfo>
Nov 15 18:50:24 user nova-compute[75634]:   <os>
Nov 15 18:50:24 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:50:24 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:50:24 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:50:24 user nova-compute[75634]:   </os>
Nov 15 18:50:24 user nova-compute[75634]:   <features>
Nov 15 18:50:24 user nova-compute[75634]:     <acpi/>
Nov 15 18:50:24 user nova-compute[75634]:     <apic/>
Nov 15 18:50:24 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:50:24 user nova-compute[75634]:   </features>
Nov 15 18:50:24 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:50:24 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:50:24 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:50:24 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:50:24 user nova-compute[75634]:   </clock>
Nov 15 18:50:24 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:50:24 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:50:24 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:50:24 user nova-compute[75634]:   </cpu>
Nov 15 18:50:24 user nova-compute[75634]:   <devices>
Nov 15 18:50:24 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:50:24 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:50:24 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk"/>
Nov 15 18:50:24 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:50:24 user nova-compute[75634]:     </disk>
Nov 15 18:50:24 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:50:24 user nova-compute[75634]:       <mac address="fa:16:3e:b6:43:b9"/>
Nov 15 18:50:24 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:24 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:50:24 user nova-compute[75634]:       <target dev="tapca729026-e4"/>
Nov 15 18:50:24 user nova-compute[75634]:     </interface>
Nov 15 18:50:24 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:50:24 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/console.log" append="off"/>
Nov 15 18:50:24 user nova-compute[75634]:     </serial>
Nov 15 18:50:24 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:50:24 user nova-compute[75634]:     <video>
Nov 15 18:50:24 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:24 user nova-compute[75634]:     </video>
Nov 15 18:50:24 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:50:24 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:50:24 user nova-compute[75634]:     </rng>
Nov 15 18:50:24 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:50:24 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:50:24 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:50:24 user nova-compute[75634]:     </memballoon>
Nov 15 18:50:24 user nova-compute[75634]:   </devices>
Nov 15 18:50:24 user nova-compute[75634]: </domain>
Nov 15 18:50:24 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1527921557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1527921557',id=37,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-l0f2a0h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:23Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=d324a863-5fde-4342-815f-da9a158d5df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG os_vif [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99fabd49-8f48-5db4-be1b-412dd5dbae6c', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca729026-e4, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca729026-e4, col_values=(('qos', UUID('efa2b4d1-5996-48af-96be-7717afd4d0e8')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca729026-e4, col_values=(('external_ids', {'iface-id': 'ca729026-e47e-4d10-affa-3e3b0c8a9faf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:43:b9', 'vm-uuid': 'd324a863-5fde-4342-815f-da9a158d5df7'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:24 user nova-compute[75634]: INFO os_vif [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4')
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:50:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:b6:43:b9, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:50:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updated VIF entry in instance network info cache for port ca729026-e47e-4d10-affa-3e3b0c8a9faf. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:25 user nova-compute[75634]: DEBUG nova.network.neutron [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updating instance_info_cache with network_info: [{"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7b21030e-0a11-4550-ae46-bec6cf1747f5 req-655bc199-3d8b-4b38-87b0-816f55876afc service nova] Releasing lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:25 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] No waiting events found dispatching network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:26 user nova-compute[75634]: WARNING nova.compute.manager [req-fd923e98-3f96-4aeb-8dca-929b309b7ed2 req-a6e3bbbd-38e3-493c-9d2d-d362a44c3b1c service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received unexpected event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf for instance with vm_state building and task_state spawning.
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.utils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[95adfbdf-e34b-44f2-bfce-d6806c2d14a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a986cd0-7e52-46cb-9bd8-fd3c1a216f12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e43942-8580-40fe-9e96-4dc34344e61c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae46fd-7d0b-45d3-a7fa-6347f46f756a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:50:27 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:50:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[118fb6e5-67ab-4967-a0d2-0ecc604d90f5]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG os_brick.utils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updating existing volume attachment record: 5dd691e1-c47b-4e27-9e35-9e1b8587e2d2 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:50:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:50:28 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Instance spawned successfully.
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:50:28 user nova-compute[75634]: INFO nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] No waiting events found dispatching network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:28 user nova-compute[75634]: WARNING nova.compute.manager [req-1444439e-4b24-4a14-a267-4abd83713ede req-1cc443c5-8a46-4c7d-9d20-b5742a6f04b2 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received unexpected event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf for instance with vm_state building and task_state spawning.
Nov 15 18:50:28 user nova-compute[75634]: INFO nova.compute.manager [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Took 6.29 seconds to build instance.
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e33283ec-ee7c-4f33-8cee-4bf86f7b6061 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:50:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:50:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.01125717163086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Applying migration context for instance 6903a62f-7273-4616-9f37-a072c7e47c48 as it has an incoming, in-progress migration 8b9fdb59-2405-46e0-8975-facc1167fd58. Migration status is finished {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 18:50:33 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating resource usage from migration 8b9fdb59-2405-46e0-8975-facc1167fd58
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:50:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Creating image(s)
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/3fd8247c-989e-4b7f-a27a-e16c19aa6b2f/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Start _get_guest_xml network_info=[{"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T18:50:16Z,direct_url=<?>,disk_format='qcow2',id=7475b8e4-c54f-41ed-8536-d8539e71d852,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1441344850',owner='3bfcc977f8a14a7c8d13d1eed1061b0f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T18:50:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUzMxChw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3fd8247c-989e-4b7f-a27a-e16c19aa6b2f', 'attached_at': '', 'detached_at': '', 'volume_id': '173c8642-e049-4022-8d87-00c8e82c31b8', 'serial': '173c8642-e049-4022-8d87-00c8e82c31b8'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '5dd691e1-c47b-4e27-9e35-9e1b8587e2d2', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 615fab46-3173-4f68-b938-c88142b8836a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Migration 8b9fdb59-2405-46e0-8975-facc1167fd58 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:50:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T18:50:16Z,direct_url=<?>,disk_format='qcow2',id=7475b8e4-c54f-41ed-8536-d8539e71d852,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1441344850',owner='3bfcc977f8a14a7c8d13d1eed1061b0f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T18:50:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUzMxChw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:50:33 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:50:33 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:50:33 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14fc67-ad55-468d-a645-067aeafda422]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:50:33 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[473981fa-06e5-4232-afe4-f0ddec1d95c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8] added
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36ed87-b0f7-4d90-a319-c16942544bc1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dba30e-be0d-406e-bf7e-8583772f599d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUzMxChw {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUzMxChw" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d86c67-f1ab-4bcb-a037-cae51c7c7f2f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUzMxChw'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75950e8-215d-4306-a7ac-fd23cc9adf90]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f4ba9-f5b1-4419-a9ed-350b56fd965c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d2f07a-1be0-4f17-98e6-464631c44897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260]
Nov 15 18:50:33 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260] successful.
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec11eef-27c4-45cb-b13f-83b27ba70330]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbce162-5041-4c48-8b23-1b2b71cd13db]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:50:33 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:50:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[969eb5e8-9152-476e-8550-fa278dd66472]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUzMxChw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:50:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23066383831666534', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066383831666534', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1849477421',id=36,image_ref='7475b8e4-c54f-41ed-8536-d8539e71d852',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOj6rJ9O+d3kInCtgO0hysZffkCH6ej3/79rfwVMvmm5HRIO8aYvgQlDIugMDtnEgEGfCgf5rv3I9MB5s4TcUVz6KIMLyxeT5WnMLZGdLCVyR51uZvhQ/GVsgol2PtLljQ==',key_name='tempest-keypair-1745289559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-dn324ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-34940949',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=3fd8247c-989e-4b7f-a27a-e16c19aa6b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:50:34 user nova-compute[75634]:   <uuid>3fd8247c-989e-4b7f-a27a-e16c19aa6b2f</uuid>
Nov 15 18:50:34 user nova-compute[75634]:   <name>instance-00000024</name>
Nov 15 18:50:34 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:50:34 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:50:34 user nova-compute[75634]:   <metadata>
Nov 15 18:50:34 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:50:34 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1849477421</nova:name>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:50:33</nova:creationTime>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:50:34 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:50:34 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:owner>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:50:34 user nova-compute[75634]:       </nova:owner>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:root type="image" uuid="7475b8e4-c54f-41ed-8536-d8539e71d852"/>
Nov 15 18:50:34 user nova-compute[75634]:       <nova:ports>
Nov 15 18:50:34 user nova-compute[75634]:         <nova:port uuid="c50fa564-6b88-4526-aecb-22bbabfc0772">
Nov 15 18:50:34 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 18:50:34 user nova-compute[75634]:         </nova:port>
Nov 15 18:50:34 user nova-compute[75634]:       </nova:ports>
Nov 15 18:50:34 user nova-compute[75634]:     </nova:instance>
Nov 15 18:50:34 user nova-compute[75634]:   </metadata>
Nov 15 18:50:34 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:50:34 user nova-compute[75634]:     <system>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="serial">3fd8247c-989e-4b7f-a27a-e16c19aa6b2f</entry>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="uuid">3fd8247c-989e-4b7f-a27a-e16c19aa6b2f</entry>
Nov 15 18:50:34 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:50:34 user nova-compute[75634]:     </system>
Nov 15 18:50:34 user nova-compute[75634]:   </sysinfo>
Nov 15 18:50:34 user nova-compute[75634]:   <os>
Nov 15 18:50:34 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:50:34 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:50:34 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:50:34 user nova-compute[75634]:   </os>
Nov 15 18:50:34 user nova-compute[75634]:   <features>
Nov 15 18:50:34 user nova-compute[75634]:     <acpi/>
Nov 15 18:50:34 user nova-compute[75634]:     <apic/>
Nov 15 18:50:34 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:50:34 user nova-compute[75634]:   </features>
Nov 15 18:50:34 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:50:34 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:50:34 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:50:34 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:50:34 user nova-compute[75634]:   </clock>
Nov 15 18:50:34 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:50:34 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:50:34 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:50:34 user nova-compute[75634]:   </cpu>
Nov 15 18:50:34 user nova-compute[75634]:   <devices>
Nov 15 18:50:34 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:50:34 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:50:34 user nova-compute[75634]:       <source dev="/dev/sdf"/>
Nov 15 18:50:34 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:50:34 user nova-compute[75634]:       <serial>173c8642-e049-4022-8d87-00c8e82c31b8</serial>
Nov 15 18:50:34 user nova-compute[75634]:     </disk>
Nov 15 18:50:34 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:50:34 user nova-compute[75634]:       <mac address="fa:16:3e:7b:90:e8"/>
Nov 15 18:50:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:34 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:50:34 user nova-compute[75634]:       <target dev="tapc50fa564-6b"/>
Nov 15 18:50:34 user nova-compute[75634]:     </interface>
Nov 15 18:50:34 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:50:34 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/3fd8247c-989e-4b7f-a27a-e16c19aa6b2f/console.log" append="off"/>
Nov 15 18:50:34 user nova-compute[75634]:     </serial>
Nov 15 18:50:34 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:50:34 user nova-compute[75634]:     <video>
Nov 15 18:50:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:34 user nova-compute[75634]:     </video>
Nov 15 18:50:34 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:50:34 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:50:34 user nova-compute[75634]:     </rng>
Nov 15 18:50:34 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:50:34 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:50:34 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:50:34 user nova-compute[75634]:     </memballoon>
Nov 15 18:50:34 user nova-compute[75634]:   </devices>
Nov 15 18:50:34 user nova-compute[75634]: </domain>
Nov 15 18:50:34 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1849477421',id=36,image_ref='7475b8e4-c54f-41ed-8536-d8539e71d852',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOj6rJ9O+d3kInCtgO0hysZffkCH6ej3/79rfwVMvmm5HRIO8aYvgQlDIugMDtnEgEGfCgf5rv3I9MB5s4TcUVz6KIMLyxeT5WnMLZGdLCVyR51uZvhQ/GVsgol2PtLljQ==',key_name='tempest-keypair-1745289559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-dn324ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-34940949',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=3fd8247c-989e-4b7f-a27a-e16c19aa6b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG os_vif [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Skipping network cache update for instance because it is Building. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53da7d9e-15db-5e71-8862-d06f6f941048', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc50fa564-6b, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc50fa564-6b, col_values=(('qos', UUID('66a2db58-7c5d-42b8-a21a-bb351c59f6e6')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc50fa564-6b, col_values=(('external_ids', {'iface-id': 'c50fa564-6b88-4526-aecb-22bbabfc0772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:90:e8', 'vm-uuid': '3fd8247c-989e-4b7f-a27a-e16c19aa6b2f'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:34 user nova-compute[75634]: INFO os_vif [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b')
Nov 15 18:50:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid b44cd307-ffbe-4ccd-996f-299ce61b60a6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:7b:90:e8, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:50:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [{"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-b44cd307-ffbe-4ccd-996f-299ce61b60a6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] No waiting events found dispatching network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:36 user nova-compute[75634]: WARNING nova.compute.manager [req-7e40ce6a-32ac-4ed9-b8db-5b135a67e552 req-7678a5a5-065b-4df5-a22f-3ab05f54b22b service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received unexpected event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 for instance with vm_state building and task_state spawning.
Nov 15 18:50:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:37 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:50:37 user nova-compute[75634]: INFO nova.compute.claims [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Claim successful on node user
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:50:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Instance spawned successfully.
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] No waiting events found dispatching network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:38 user nova-compute[75634]: WARNING nova.compute.manager [req-71af8fd7-7612-49f7-8493-2cf0d6f1f2c7 req-9a7ec3c7-c797-415d-a9e1-2b0a024b6687 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received unexpected event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 for instance with vm_state building and task_state spawning.
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:50:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:50:38 user nova-compute[75634]: INFO nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.policy [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89755cafe30b4013b0642283a83bab00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812d9a6afc424b4eb1e6d50d3035531a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:50:38 user nova-compute[75634]: INFO nova.compute.manager [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Took 18.21 seconds to build instance.
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f990e87c-2b38-4de1-ad5b-62412a88e7a4 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.567s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:50:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Creating image(s)
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk 1073741824" returned: 0 in 0.062s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Successfully created port: dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Cannot resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Ensure instance console log exists: /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Successfully updated port: dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquired lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:50:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Releasing lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance network_info: |[{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start _get_guest_xml network_info=[{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:50:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:50:40 user nova-compute[75634]:   <uuid>1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</uuid>
Nov 15 18:50:40 user nova-compute[75634]:   <name>instance-00000026</name>
Nov 15 18:50:40 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:50:40 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:50:40 user nova-compute[75634]:   <metadata>
Nov 15 18:50:40 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:50:40 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeTestJSON-server-643925418</nova:name>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:50:40</nova:creationTime>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:50:40 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:50:40 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:owner>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:user uuid="89755cafe30b4013b0642283a83bab00">tempest-AttachVolumeTestJSON-915928723-project-member</nova:user>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:project uuid="812d9a6afc424b4eb1e6d50d3035531a">tempest-AttachVolumeTestJSON-915928723</nova:project>
Nov 15 18:50:40 user nova-compute[75634]:       </nova:owner>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:50:40 user nova-compute[75634]:       <nova:ports>
Nov 15 18:50:40 user nova-compute[75634]:         <nova:port uuid="dcfb27d8-ed70-4d06-a254-0dd85a62cde1">
Nov 15 18:50:40 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:50:40 user nova-compute[75634]:         </nova:port>
Nov 15 18:50:40 user nova-compute[75634]:       </nova:ports>
Nov 15 18:50:40 user nova-compute[75634]:     </nova:instance>
Nov 15 18:50:40 user nova-compute[75634]:   </metadata>
Nov 15 18:50:40 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:50:40 user nova-compute[75634]:     <system>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="serial">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="uuid">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:50:40 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:50:40 user nova-compute[75634]:     </system>
Nov 15 18:50:40 user nova-compute[75634]:   </sysinfo>
Nov 15 18:50:40 user nova-compute[75634]:   <os>
Nov 15 18:50:40 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:50:40 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:50:40 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:50:40 user nova-compute[75634]:   </os>
Nov 15 18:50:40 user nova-compute[75634]:   <features>
Nov 15 18:50:40 user nova-compute[75634]:     <acpi/>
Nov 15 18:50:40 user nova-compute[75634]:     <apic/>
Nov 15 18:50:40 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:50:40 user nova-compute[75634]:   </features>
Nov 15 18:50:40 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:50:40 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:50:40 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:50:40 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:50:40 user nova-compute[75634]:   </clock>
Nov 15 18:50:40 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:50:40 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:50:40 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:50:40 user nova-compute[75634]:   </cpu>
Nov 15 18:50:40 user nova-compute[75634]:   <devices>
Nov 15 18:50:40 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:50:40 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:50:40 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk"/>
Nov 15 18:50:40 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:50:40 user nova-compute[75634]:     </disk>
Nov 15 18:50:40 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:50:40 user nova-compute[75634]:       <mac address="fa:16:3e:d2:0b:cc"/>
Nov 15 18:50:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:40 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:50:40 user nova-compute[75634]:       <target dev="tapdcfb27d8-ed"/>
Nov 15 18:50:40 user nova-compute[75634]:     </interface>
Nov 15 18:50:40 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:50:40 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/console.log" append="off"/>
Nov 15 18:50:40 user nova-compute[75634]:     </serial>
Nov 15 18:50:40 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:50:40 user nova-compute[75634]:     <video>
Nov 15 18:50:40 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:50:40 user nova-compute[75634]:     </video>
Nov 15 18:50:40 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:50:40 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:50:40 user nova-compute[75634]:     </rng>
Nov 15 18:50:40 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:50:40 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:50:40 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:50:40 user nova-compute[75634]:     </memballoon>
Nov 15 18:50:40 user nova-compute[75634]:   </devices>
Nov 15 18:50:40 user nova-compute[75634]: </domain>
Nov 15 18:50:40 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG os_vif [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bb5d7f1-8f54-5416-9165-4fc3c71e251e', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcfb27d8-ed, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcfb27d8-ed, col_values=(('qos', UUID('c40c7dc7-e9c3-4729-a45c-df7e861e604a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcfb27d8-ed, col_values=(('external_ids', {'iface-id': 'dcfb27d8-ed70-4d06-a254-0dd85a62cde1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0b:cc', 'vm-uuid': '1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:40 user nova-compute[75634]: INFO os_vif [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No VIF found with MAC fa:16:3e:d2:0b:cc, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-changed-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Refreshing instance network info cache due to event network-changed-dcfb27d8-ed70-4d06-a254-0dd85a62cde1. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] Acquiring lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] Acquired lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Refreshing network info cache for port dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updated VIF entry in instance network info cache for port dcfb27d8-ed70-4d06-a254-0dd85a62cde1. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a37ebfa6-277a-4c31-a491-c1ef7321736f req-14df7b80-c5fe-4749-a7f3-a234f1ccf240 service nova] Releasing lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:42 user nova-compute[75634]: WARNING nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state building and task_state spawning.
Nov 15 18:50:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:42 user nova-compute[75634]: WARNING nova.compute.manager [req-3bba53ff-6ee5-47ed-8420-c3a435a70295 req-8bd67689-95d7-4b20-9a7c-3ada5e4d8efd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state building and task_state spawning.
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:50:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance spawned successfully.
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:50:44 user nova-compute[75634]: INFO nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 18:50:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:50:44 user nova-compute[75634]: INFO nova.compute.manager [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Took 6.51 seconds to build instance.
Nov 15 18:50:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b2046ef4-6b14-4a84-afc2-28f2f97658d4 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.598s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:46 user nova-compute[75634]: INFO nova.compute.manager [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Terminating instance
Nov 15 18:50:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-unplugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] No waiting events found dispatching network-vif-unplugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-35744ce4-3316-47ce-98a5-06a23b6cae7a req-e86a1d9a-698d-4498-abaa-bbffee326c7c service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-unplugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:50:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Instance destroyed successfully.
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lazy-loading 'resources' on Instance uuid 615fab46-3173-4f68-b938-c88142b8836a {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2001652328',display_name='tempest-TestServerVolumeAttachmentScenario-server-2001652328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2001652328',id=32,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl60T3DlaUczJk2Zwoi3h9SM0ss/Q6+kUDXX1NLEIXhXMEccyD8ZK9VbqGu/P6Wn3FTrUxp/GAIoUHNmFLGUkd4JL1gR5yKh7iauBsgsUBfMMBYJwHXVDSV8PwpyMjTEg==',key_name='tempest-keypair-406405799',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d234e65d9a4542b82a6d9bb0545523',ramdisk_id='',reservation_id='r-19drwqhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1721559897',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1721559897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bb679f2e1c44f8eae59835d407bb39b',uuid=615fab46-3173-4f68-b938-c88142b8836a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converting VIF {"id": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "address": "fa:16:3e:7d:22:e6", "network": {"id": "2fd4a699-ae34-49b5-9d8f-12c14bd92f17", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2117372292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d234e65d9a4542b82a6d9bb0545523", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48640e4b-6a", "ovs_interfaceid": "48640e4b-6a0a-4533-a947-5f9f89d26f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG os_vif [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48640e4b-6a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50956555-ba5b-4815-a7c5-86b8b8a6c539) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:50:47 user nova-compute[75634]: INFO os_vif [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:22:e6,bridge_name='br-int',has_traffic_filtering=True,id=48640e4b-6a0a-4533-a947-5f9f89d26f1d,network=Network(2fd4a699-ae34-49b5-9d8f-12c14bd92f17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48640e4b-6a')
Nov 15 18:50:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Deleting instance files /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a_del
Nov 15 18:50:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Deletion of /opt/stack/data/nova/instances/615fab46-3173-4f68-b938-c88142b8836a_del complete
Nov 15 18:50:47 user nova-compute[75634]: INFO nova.compute.manager [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 18:50:47 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:50:47 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:50:48 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:48 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Took 0.77 seconds to deallocate network for instance.
Nov 15 18:50:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:48 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:50:48 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:50:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:48 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Deleted allocations for instance 615fab46-3173-4f68-b938-c88142b8836a
Nov 15 18:50:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16b21ff8-3973-4115-a182-8c3244b05a57 tempest-TestServerVolumeAttachmentScenario-1721559897 tempest-TestServerVolumeAttachmentScenario-1721559897-project-member] Lock "615fab46-3173-4f68-b938-c88142b8836a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] Acquiring lock "615fab46-3173-4f68-b938-c88142b8836a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] Lock "615fab46-3173-4f68-b938-c88142b8836a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:50:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] No waiting events found dispatching network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:50:49 user nova-compute[75634]: WARNING nova.compute.manager [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received unexpected event network-vif-plugged-48640e4b-6a0a-4533-a947-5f9f89d26f1d for instance with vm_state deleted and task_state None.
Nov 15 18:50:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-9d7a3742-7fd0-4870-868d-7ecfa7c0d660 req-ef5dc147-59b3-4f0c-a8ac-06906808a8ee service nova] [instance: 615fab46-3173-4f68-b938-c88142b8836a] Received event network-vif-deleted-48640e4b-6a0a-4533-a947-5f9f89d26f1d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing instance network info cache due to event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updated VIF entry in instance network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e81afa7c-4795-4222-9eec-7ed0391373a9 req-126ababb-b847-4721-b4d7-5919f1f74438 service nova] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing instance network info cache due to event network-changed-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] Acquiring lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] Acquired lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Refreshing network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:50:52 user nova-compute[75634]: INFO nova.compute.manager [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Detaching volume e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:50:52 user nova-compute[75634]: INFO nova.virt.block_device [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Attempting to driver detach volume e66841c8-9dc0-47b8-855e-6e1d823060ad from mountpoint /dev/vdb
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Attempting to detach device vdb from instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:50:52 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:50:52 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:50:52 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:50:52 user nova-compute[75634]:   <serial>e66841c8-9dc0-47b8-855e-6e1d823060ad</serial>
Nov 15 18:50:52 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:50:52 user nova-compute[75634]: </disk>
Nov 15 18:50:52 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:50:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully detached device vdb from instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 from the persistent domain config.
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:50:52 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:50:52 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:50:52 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:50:52 user nova-compute[75634]:   <serial>e66841c8-9dc0-47b8-855e-6e1d823060ad</serial>
Nov 15 18:50:52 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:50:52 user nova-compute[75634]: </disk>
Nov 15 18:50:52 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updated VIF entry in instance network info cache for port 4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [{"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-251c892a-620b-470d-ad4f-c46ae96d71c2 req-524d27be-cccf-4fea-a3f8-cb57f6b3c81a service nova] Releasing lock "refresh_cache-f89d2edf-0b80-484f-9176-76a0bf07d6d4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:50:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:50:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:00 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:51:00 user nova-compute[75634]: INFO nova.compute.claims [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Claim successful on node user
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:51:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:51:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.policy [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a54ff6670dd74beea8b818f8cbd2e93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b1bd5fcf764dbda726e347edd1e63a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:51:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Creating image(s)
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "/opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk 1073741824" returned: 0 in 0.063s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:01 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Successfully created port: 2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Cannot resize image /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Ensure instance console log exists: /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Successfully updated port: 2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquired lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-changed-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Refreshing instance network info cache due to event network-changed-2ab0966b-93fd-48f0-86d8-f5b549e09ecb. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:51:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] Acquiring lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updating instance_info_cache with network_info: [{"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Releasing lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Instance network_info: |[{"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] Acquired lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Refreshing network info cache for port 2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Start _get_guest_xml network_info=[{"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:51:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:51:03 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453599867',display_name='tempest-AttachVolumeNegativeTest-server-453599867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453599867',id=39,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXhfTGktz1OkKFDiWyriej8fmjzdbOQrIruwkb7DA67Q1pBiresuWDBMw35K5dJPP+rWgX+0laN7ra7m91NRp/Z/tgAXUAx1KCKzSuWdzTiosHnteZ29RZRKuwTkCmPkg==',key_name='tempest-keypair-101845244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-x008pn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=fe8f976c-9856-4fb4-82ff-14ad221ab044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.objects.instance [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'pci_devices' on Instance uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:51:03 user nova-compute[75634]:   <uuid>fe8f976c-9856-4fb4-82ff-14ad221ab044</uuid>
Nov 15 18:51:03 user nova-compute[75634]:   <name>instance-00000027</name>
Nov 15 18:51:03 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:51:03 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:51:03 user nova-compute[75634]:   <metadata>
Nov 15 18:51:03 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:51:03 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeNegativeTest-server-453599867</nova:name>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:51:03</nova:creationTime>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:51:03 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:51:03 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:owner>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:user uuid="a54ff6670dd74beea8b818f8cbd2e93c">tempest-AttachVolumeNegativeTest-1838989545-project-member</nova:user>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:project uuid="a8b1bd5fcf764dbda726e347edd1e63a">tempest-AttachVolumeNegativeTest-1838989545</nova:project>
Nov 15 18:51:03 user nova-compute[75634]:       </nova:owner>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:51:03 user nova-compute[75634]:       <nova:ports>
Nov 15 18:51:03 user nova-compute[75634]:         <nova:port uuid="2ab0966b-93fd-48f0-86d8-f5b549e09ecb">
Nov 15 18:51:03 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 18:51:03 user nova-compute[75634]:         </nova:port>
Nov 15 18:51:03 user nova-compute[75634]:       </nova:ports>
Nov 15 18:51:03 user nova-compute[75634]:     </nova:instance>
Nov 15 18:51:03 user nova-compute[75634]:   </metadata>
Nov 15 18:51:03 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:51:03 user nova-compute[75634]:     <system>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="serial">fe8f976c-9856-4fb4-82ff-14ad221ab044</entry>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="uuid">fe8f976c-9856-4fb4-82ff-14ad221ab044</entry>
Nov 15 18:51:03 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:51:03 user nova-compute[75634]:     </system>
Nov 15 18:51:03 user nova-compute[75634]:   </sysinfo>
Nov 15 18:51:03 user nova-compute[75634]:   <os>
Nov 15 18:51:03 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:51:03 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:51:03 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:51:03 user nova-compute[75634]:   </os>
Nov 15 18:51:03 user nova-compute[75634]:   <features>
Nov 15 18:51:03 user nova-compute[75634]:     <acpi/>
Nov 15 18:51:03 user nova-compute[75634]:     <apic/>
Nov 15 18:51:03 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:51:03 user nova-compute[75634]:   </features>
Nov 15 18:51:03 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:51:03 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:51:03 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:51:03 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:51:03 user nova-compute[75634]:   </clock>
Nov 15 18:51:03 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:51:03 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:51:03 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:51:03 user nova-compute[75634]:   </cpu>
Nov 15 18:51:03 user nova-compute[75634]:   <devices>
Nov 15 18:51:03 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:51:03 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:51:03 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk"/>
Nov 15 18:51:03 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:51:03 user nova-compute[75634]:     </disk>
Nov 15 18:51:03 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:51:03 user nova-compute[75634]:       <mac address="fa:16:3e:85:bc:65"/>
Nov 15 18:51:03 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:51:03 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:51:03 user nova-compute[75634]:       <target dev="tap2ab0966b-93"/>
Nov 15 18:51:03 user nova-compute[75634]:     </interface>
Nov 15 18:51:03 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:51:03 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/console.log" append="off"/>
Nov 15 18:51:03 user nova-compute[75634]:     </serial>
Nov 15 18:51:03 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:51:03 user nova-compute[75634]:     <video>
Nov 15 18:51:03 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:51:03 user nova-compute[75634]:     </video>
Nov 15 18:51:03 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:51:03 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:51:03 user nova-compute[75634]:     </rng>
Nov 15 18:51:03 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:51:03 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:51:03 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:51:03 user nova-compute[75634]:     </memballoon>
Nov 15 18:51:03 user nova-compute[75634]:   </devices>
Nov 15 18:51:03 user nova-compute[75634]: </domain>
Nov 15 18:51:03 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453599867',display_name='tempest-AttachVolumeNegativeTest-server-453599867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453599867',id=39,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXhfTGktz1OkKFDiWyriej8fmjzdbOQrIruwkb7DA67Q1pBiresuWDBMw35K5dJPP+rWgX+0laN7ra7m91NRp/Z/tgAXUAx1KCKzSuWdzTiosHnteZ29RZRKuwTkCmPkg==',key_name='tempest-keypair-101845244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-x008pn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=fe8f976c-9856-4fb4-82ff-14ad221ab044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG os_vif [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7507dea0-6aab-5809-85de-5c9a4365acfc', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab0966b-93, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ab0966b-93, col_values=(('qos', UUID('1cf3010f-a2ad-4399-a7dd-f80fad4ec443')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ab0966b-93, col_values=(('external_ids', {'iface-id': '2ab0966b-93fd-48f0-86d8-f5b549e09ecb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:bc:65', 'vm-uuid': 'fe8f976c-9856-4fb4-82ff-14ad221ab044'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:03 user nova-compute[75634]: INFO os_vif [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93')
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:85:bc:65, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updated VIF entry in instance network info cache for port 2ab0966b-93fd-48f0-86d8-f5b549e09ecb. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG nova.network.neutron [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updating instance_info_cache with network_info: [{"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-97777271-e4a5-42b6-8bf6-169203a46be6 req-7e87c08d-4b8a-4fc3-9c33-866a6eb8cf41 service nova] Releasing lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:51:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] No waiting events found dispatching network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:05 user nova-compute[75634]: WARNING nova.compute.manager [req-0ce2d988-f6e3-411e-9c77-3e59b396d87a req-ac6a2504-832c-4441-8666-85d9d209c2d8 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received unexpected event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb for instance with vm_state building and task_state spawning.
Nov 15 18:51:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:51:06 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Instance spawned successfully.
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:06 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:51:07 user nova-compute[75634]: INFO nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 15 18:51:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:51:07 user nova-compute[75634]: INFO nova.compute.manager [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Took 6.39 seconds to build instance.
Nov 15 18:51:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-07f16eb7-3799-4262-8aad-37923cfc1975 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.487s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] No waiting events found dispatching network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:07 user nova-compute[75634]: WARNING nova.compute.manager [req-d686cd2f-b6fc-425b-bdef-b544a9c8756b req-eb0eeb51-c3cf-4c9f-b45e-c2149a8d0e8c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received unexpected event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb for instance with vm_state active and task_state None.
Nov 15 18:51:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:12 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 is timed out.
Nov 15 18:51:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully detached device vdb from instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 from the live domain config.
Nov 15 18:51:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlanYuio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:51:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e931274f-a227-4e64-b9d4-2b8a021ca3b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:51:13 user nova-compute[75634]: No targets found.
Nov 15 18:51:13 user nova-compute[75634]: iSNS:
Nov 15 18:51:13 user nova-compute[75634]: No targets found.
Nov 15 18:51:13 user nova-compute[75634]: STATIC:
Nov 15 18:51:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:51:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:51:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:51:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:51:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:51:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:51:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:51:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:51:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:51:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad
Nov 15 18:51:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:51:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:51:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8
Nov 15 18:51:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:51:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:51:13 user nova-compute[75634]: FIRMWARE:
Nov 15 18:51:13 user nova-compute[75634]: No targets found.
Nov 15 18:51:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:51:13 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:51:13 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e463e2c8-d086-494a-8a84-cea06828d6aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b4b44-7a0e-423b-98c7-c8cd355acfa2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:51:13 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:51:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b681bdab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa01e9-a8ed-4d72-841f-bf962da0e9ea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a0c102-d304-4db7-94f7-6b03a12d920b]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3eb032-a6c6-428b-a35b-67ba0f20cc16]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9809d245-3c10-4471-aef2-9c268a5db300]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[771c5bc4-9e47-4644-a601-79b8c757aecb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[11843fd9-0cfb-48ba-a7a8-06475b46e858]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260]
Nov 15 18:51:13 user nova-compute[75634]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad, portal: 172.16.0.220,3260] successful.
Nov 15 18:51:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66841c8-9dc0-47b8-855e-6e1d823060ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480c941-efe9-4a7f-865e-3364865c8036]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== disconnect_volume: return (331ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:51:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-147962d1-d67f-4f46-b9ac-fd7caa315fec tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:51:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:51:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7180MB free_disk=24.952125549316406GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Applying migration context for instance 6903a62f-7273-4616-9f37-a072c7e47c48 as it has an incoming, in-progress migration 8b9fdb59-2405-46e0-8975-facc1167fd58. Migration status is finished {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 18:51:33 user nova-compute[75634]: INFO nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating resource usage from migration 8b9fdb59-2405-46e0-8975-facc1167fd58
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance f89d2edf-0b80-484f-9176-76a0bf07d6d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Migration 8b9fdb59-2405-46e0-8975-facc1167fd58 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fe8f976c-9856-4fb4-82ff-14ad221ab044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:51:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:51:34 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:51:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:51:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:51:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:51:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:51:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:39 user nova-compute[75634]: INFO nova.compute.manager [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Unrescuing
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'flavor' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:39 user nova-compute[75634]: WARNING nova.compute.manager [req-ea286b9f-4e68-40f5-b408-5c268f522d17 req-ab9b3918-06fc-4211-af4d-c1209c86f74b service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:51:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance destroyed successfully.
Nov 15 18:51:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Going to confirm migration 2 {{(pid=75634) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquired lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'info_cache' on Instance uuid 6903a62f-7273-4616-9f37-a072c7e47c48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:41 user nova-compute[75634]: WARNING nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:41 user nova-compute[75634]: WARNING nova.compute.manager [req-16b4e2df-4604-47c3-9883-838c1df80e0c req-bb8086f2-c115-4cdc-9734-d4eb83fa2fe4 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:51:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [{"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Releasing lock "refresh_cache-6903a62f-7273-4616-9f37-a072c7e47c48" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'migration_context' on Instance uuid 6903a62f-7273-4616-9f37-a072c7e47c48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG nova.objects.base [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Object Instance<6903a62f-7273-4616-9f37-a072c7e47c48> lazy-loaded attributes: info_cache,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:51:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.440s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:42 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Deleted allocation for migration 8b9fdb59-2405-46e0-8975-facc1167fd58
Nov 15 18:51:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-12d4382e-d418-4b11-a86c-14a9961224f5 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.461s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9cba598e-4f76-4690-b175-606854fd96f2 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:43 user nova-compute[75634]: WARNING nova.compute.manager [req-6b8a7d7a-bd8b-48dd-a244-1c22ee2e161c req-08d924d9-3228-4a8e-bb0c-fe77c4d2a59d service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state active and task_state None.
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:46 user nova-compute[75634]: INFO nova.compute.manager [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Terminating instance
Nov 15 18:51:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-ad22917b-22cd-4b8b-b33d-2008e311e8be req-d88a16ad-7f5b-44a0-828e-2e2e7f5b0151 service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-unplugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:51:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Instance destroyed successfully.
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'resources' on Instance uuid f89d2edf-0b80-484f-9176-76a0bf07d6d4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1410239741',display_name='tempest-TestMinimumBasicScenario-server-1410239741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1410239741',id=31,image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSTp6zHtWCacdjees+fCD3XocujlOiONywYv1JLxG/Y+wuTqGgfF28sE6CCMNYdeKZDJwDFTzhylfC7qDz+gStwaZ6ACCSkPGlkV3odGzYbVrdDrkeLXOJgVlbJlZMag==',key_name='tempest-TestMinimumBasicScenario-536838068',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-0torcj84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6f1e808b-e222-4001-924b-60dcfac9da06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:49:07Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=f89d2edf-0b80-484f-9176-76a0bf07d6d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "address": "fa:16:3e:ad:30:fe", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbbb306-50", "ovs_interfaceid": "4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG os_vif [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dbbb306-50, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3862cdf8-d53a-4e2b-8cf0-51cfd19ee37c) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:47 user nova-compute[75634]: INFO os_vif [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:30:fe,bridge_name='br-int',has_traffic_filtering=True,id=4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbbb306-50')
Nov 15 18:51:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Deleting instance files /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4_del
Nov 15 18:51:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Deletion of /opt/stack/data/nova/instances/f89d2edf-0b80-484f-9176-76a0bf07d6d4_del complete
Nov 15 18:51:47 user nova-compute[75634]: INFO nova.compute.manager [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 18:51:47 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:51:47 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:51:48 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Took 1.37 seconds to deallocate network for instance.
Nov 15 18:51:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] Acquiring lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] No waiting events found dispatching network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:51:48 user nova-compute[75634]: WARNING nova.compute.manager [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received unexpected event network-vif-plugged-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed for instance with vm_state deleted and task_state None.
Nov 15 18:51:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-b3d30db2-2979-4bed-8ee7-4032472e275a req-edbc07c5-cdc4-4f19-806b-bc1ecd93f13e service nova] [instance: f89d2edf-0b80-484f-9176-76a0bf07d6d4] Received event network-vif-deleted-4dbbb306-50d2-4d3d-9fe4-c343c5fb20ed {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:51:49 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:51:49 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:51:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:49 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Deleted allocations for instance f89d2edf-0b80-484f-9176-76a0bf07d6d4
Nov 15 18:51:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-7d5ef1e2-797f-4ce1-a72c-4337e7e41ce9 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "f89d2edf-0b80-484f-9176-76a0bf07d6d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:51:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:51:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:52:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-changed-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Refreshing instance network info cache due to event network-changed-c50fa564-6b88-4526-aecb-22bbabfc0772. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:52:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] Acquiring lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] Acquired lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Refreshing network info cache for port c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:11 user nova-compute[75634]: INFO nova.compute.manager [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Terminating instance
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updated VIF entry in instance network info cache for port c50fa564-6b88-4526-aecb-22bbabfc0772. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updating instance_info_cache with network_info: [{"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1237c6ec-9244-47d1-91d2-b0873373a92b req-4916f313-d317-48a1-8934-caf6bd49f6f2 service nova] Releasing lock "refresh_cache-3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-unplugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] No waiting events found dispatching network-vif-unplugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-28f035fe-ae67-4e87-b96a-e22025e38b63 req-b91e1554-eacd-4bfe-8d16-db243762bfe5 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-unplugged-c50fa564-6b88-4526-aecb-22bbabfc0772 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Instance destroyed successfully.
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1849477421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1849477421',id=36,image_ref='7475b8e4-c54f-41ed-8536-d8539e71d852',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOj6rJ9O+d3kInCtgO0hysZffkCH6ej3/79rfwVMvmm5HRIO8aYvgQlDIugMDtnEgEGfCgf5rv3I9MB5s4TcUVz6KIMLyxeT5WnMLZGdLCVyR51uZvhQ/GVsgol2PtLljQ==',key_name='tempest-keypair-1745289559',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-dn324ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-34940949',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=3fd8247c-989e-4b7f-a27a-e16c19aa6b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c50fa564-6b88-4526-aecb-22bbabfc0772", "address": "fa:16:3e:7b:90:e8", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc50fa564-6b", "ovs_interfaceid": "c50fa564-6b88-4526-aecb-22bbabfc0772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_vif [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc50fa564-6b, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66a2db58-7c5d-42b8-a21a-bb351c59f6e6) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:12 user nova-compute[75634]: INFO os_vif [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:90:e8,bridge_name='br-int',has_traffic_filtering=True,id=c50fa564-6b88-4526-aecb-22bbabfc0772,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc50fa564-6b')
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUzMxChw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:52:12 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[78722321-b33d-4e75-ada6-77b56a553b5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:52:12 user nova-compute[75634]: No targets found.
Nov 15 18:52:12 user nova-compute[75634]: iSNS:
Nov 15 18:52:12 user nova-compute[75634]: No targets found.
Nov 15 18:52:12 user nova-compute[75634]: STATIC:
Nov 15 18:52:12 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:52:12 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:52:12 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:52:12 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:52:12 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:52:12 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:52:12 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:52:12 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:52:12 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:52:12 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8
Nov 15 18:52:12 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:52:12 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:52:12 user nova-compute[75634]: FIRMWARE:
Nov 15 18:52:12 user nova-compute[75634]: No targets found.
Nov 15 18:52:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:52:12 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:52:12 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff4292-3e16-4bab-9c23-a5854188b4e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e592db2-1782-4e4e-a2a0-07fb167738d3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:12 user nova-compute[75634]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 (non-flash)
Nov 15 18:52:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68107370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebfb712-086d-4ef8-bf62-109a29849cc8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f431ab-fee5-4e43-a8a5-4b06ec8cc8f3]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c17f2a-dfd7-4705-95ae-73fac157fecf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d725dfd-891d-4529-a184-437acf3f47ee]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5753698-8101-452c-81bc-6b4824c3081c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a47357-895b-402e-8603-f648dd7e1160]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260]
Nov 15 18:52:12 user nova-compute[75634]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8, portal: 172.16.0.220,3260] successful.
Nov 15 18:52:12 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c8642-e049-4022-8d87-00c8e82c31b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf709e-c391-40ed-8f49-c3e1ca50ea67]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (350ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:52:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Deleting instance files /opt/stack/data/nova/instances/3fd8247c-989e-4b7f-a27a-e16c19aa6b2f_del
Nov 15 18:52:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Deletion of /opt/stack/data/nova/instances/3fd8247c-989e-4b7f-a27a-e16c19aa6b2f_del complete
Nov 15 18:52:12 user nova-compute[75634]: INFO nova.compute.manager [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 15 18:52:12 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:52:12 user nova-compute[75634]: DEBUG nova.compute.manager [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:52:12 user nova-compute[75634]: INFO nova.compute.manager [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] instance snapshotting
Nov 15 18:52:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Beginning live snapshot process
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:13 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Took 0.73 seconds to deallocate network for instance.
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.221s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919.delta 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919.delta 1073741824" returned: 0 in 0.065s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 18:52:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] Acquiring lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] No waiting events found dispatching network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:14 user nova-compute[75634]: WARNING nova.compute.manager [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received unexpected event network-vif-plugged-c50fa564-6b88-4526-aecb-22bbabfc0772 for instance with vm_state active and task_state deleting.
Nov 15 18:52:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-18e4b60e-b52a-485a-85a9-98ed29dc39bf req-95086fe4-1565-47a5-8b4f-3d0bfbe819b4 service nova] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Received event network-vif-deleted-c50fa564-6b88-4526-aecb-22bbabfc0772 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:52:14 user nova-compute[75634]: INFO nova.compute.manager [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Took 1.39 seconds to detach 1 volumes for instance.
Nov 15 18:52:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f] Deleting volume: 173c8642-e049-4022-8d87-00c8e82c31b8 {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:52:15 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 18:52:15 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919.delta /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:52:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:15 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance 3fd8247c-989e-4b7f-a27a-e16c19aa6b2f
Nov 15 18:52:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d9c52944-ac64-4255-b19d-91062c4864ec tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "3fd8247c-989e-4b7f-a27a-e16c19aa6b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.321s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919.delta /opt/stack/data/nova/instances/snapshots/tmpxstdgkda/56c5822cf10f4686aff8de0b81e25919" returned: 0 in 0.711s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Snapshot extracted, beginning image upload
Nov 15 18:52:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:18 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Snapshot image upload complete
Nov 15 18:52:18 user nova-compute[75634]: INFO nova.compute.manager [None req-34945b75-9941-46f1-95c0-a698041d1f81 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Took 5.56 seconds to snapshot the instance on the hypervisor.
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:52:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:24 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 18:52:27 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-changed-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Refreshing instance network info cache due to event network-changed-dcfb27d8-ed70-4d06-a254-0dd85a62cde1. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] Acquiring lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] Acquired lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Refreshing network info cache for port dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:52:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updated VIF entry in instance network info cache for port dcfb27d8-ed70-4d06-a254-0dd85a62cde1. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:52:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c953f234-571d-4e36-934f-1f0a5ec1afc5 req-e33537d3-b2a5-4cf2-b991-98be29290539 service nova] Releasing lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:52:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:31 user nova-compute[75634]: INFO nova.compute.manager [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Attaching volume 22b7f92c-945d-4e23-be2b-59c467cd540b to /dev/vdb
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[23209b52-45b8-4388-ae84-9249ae86f913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8681ecce-7a77-4cbb-8a17-cf09b25a336f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906987c-a726-4724-b940-03b469209b0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bb0de-cf17-45c5-92c3-8dd4e55ceac7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:52:31 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8636c4cd-ee6d-4c95-a9f2-3207962269e9]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG os_brick.utils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating existing volume attachment record: a2e9b0b0-775d-4219-bb96-dd9133fd82d8 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:34 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:52:34 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=24.902503967285156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fe8f976c-9856-4fb4-82ff-14ad221ab044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:52:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.787s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:52:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:52:36 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:52:36 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[60197f46-c835-4157-8739-30f5724c4f88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:52:36 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b4b25-3dae-4d5e-810c-44dae4983f2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b] added
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02285e0-cb76-42dd-80d8-5e2252051c53]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd28fe-0a90-49eb-815e-dc3c0be4f08b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYjwbIc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYjwbIc" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e771a3-cc3f-4d8a-8c90-a2168f6be9ed]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exYjwbIc'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26b9b1-2ef0-4c9d-bfb6-c9eb6e1974f3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05701c-3a60-4268-86e2-4e1a0054b245]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2725db-9248-436c-9b69-149024b9254d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]
Nov 15 18:52:36 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d6a434-dc2b-433b-95a8-dca62dabbd24]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92133927-132b-42b8-9565-6730a35a14db]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:36 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb8670-cfd7-48b6-ab9f-3b78c4c7005b]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 18:52:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23264613433613136', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264613433613136', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:52:37 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:52:37 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:52:37 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:52:37 user nova-compute[75634]:   <serial>22b7f92c-945d-4e23-be2b-59c467cd540b</serial>
Nov 15 18:52:37 user nova-compute[75634]: </disk>
Nov 15 18:52:37 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No VIF found with MAC fa:16:3e:d2:0b:cc, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:52:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1cdaa3a1-ee3a-425e-a92b-135f5aab06e1 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.951s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75634) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:39 user nova-compute[75634]: WARNING nova.compute.manager [req-e1d22108-895a-4864-beaf-52190da7a9b3 req-85dab9c6-95d6-4bb6-9643-1984056ed62a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state active and task_state powering-off.
Nov 15 18:52:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance destroyed successfully.
Nov 15 18:52:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:52:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-305318a4-10c9-41c5-92c3-8c4208ddeca5 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.898s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:52:40 user nova-compute[75634]: INFO nova.compute.claims [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Claim successful on node user
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:41 user nova-compute[75634]: WARNING nova.compute.manager [req-8cc60362-66be-4289-a330-9b0e51d827b9 req-3045b350-3123-4019-a50b-6c5ac12062fd service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state stopped and task_state None.
Nov 15 18:52:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.policy [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfa5c40718134a13a514c8a165b42ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247be554293e4d36a923272a63270742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:52:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Creating image(s)
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "/opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "/opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "/opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Successfully created port: b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.virt.images [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] 7cd3eb93-8b79-4da9-b6a2-adc5320602a4 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:52:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.part /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.part /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.converted" returned: 0 in 0.425s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Successfully updated port: b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.300s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance network_info: |[{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09,backing_fmt=raw /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09,backing_fmt=raw /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk 1073741824" returned: 0 in 0.060s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "18116f038e14afafe4e5882cb15bf8d86cac2e09" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-changed-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing instance network info cache due to event network-changed-b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing network info cache for port b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Cannot resize image /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Ensure instance console log exists: /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Start _get_guest_xml network_info=[{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:52:38Z,direct_url=<?>,disk_format='qcow2',id=7cd3eb93-8b79-4da9-b6a2-adc5320602a4,min_disk=0,min_ram=0,name='tempest-scenario-img--1568229319',owner='247be554293e4d36a923272a63270742',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:52:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '7cd3eb93-8b79-4da9-b6a2-adc5320602a4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:52:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:52:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:52:38Z,direct_url=<?>,disk_format='qcow2',id=7cd3eb93-8b79-4da9-b6a2-adc5320602a4,min_disk=0,min_ram=0,name='tempest-scenario-img--1568229319',owner='247be554293e4d36a923272a63270742',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:52:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285570684',display_name='tempest-TestMinimumBasicScenario-server-285570684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285570684',id=40,image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA6erBWORk9is5A20OxR3sH2uEqngO6OE9qLuz4twB3AXcs3ChN1jOkVs2GtpiIzu9PhQTwf8qItmzrULCgmGObDC8+pslwxWCrF6gC+JDZqriPbmaCJDN2vd0ybP2CMg==',key_name='tempest-TestMinimumBasicScenario-318052602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-685emy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:52:41Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=e703006a-80fb-438a-9bcb-3149a505a116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'pci_devices' on Instance uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:52:43 user nova-compute[75634]:   <uuid>e703006a-80fb-438a-9bcb-3149a505a116</uuid>
Nov 15 18:52:43 user nova-compute[75634]:   <name>instance-00000028</name>
Nov 15 18:52:43 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:52:43 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:52:43 user nova-compute[75634]:   <metadata>
Nov 15 18:52:43 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:52:43 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:name>tempest-TestMinimumBasicScenario-server-285570684</nova:name>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:52:43</nova:creationTime>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:52:43 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:52:43 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:owner>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:user uuid="cfa5c40718134a13a514c8a165b42ab3">tempest-TestMinimumBasicScenario-547369327-project-member</nova:user>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:project uuid="247be554293e4d36a923272a63270742">tempest-TestMinimumBasicScenario-547369327</nova:project>
Nov 15 18:52:43 user nova-compute[75634]:       </nova:owner>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:root type="image" uuid="7cd3eb93-8b79-4da9-b6a2-adc5320602a4"/>
Nov 15 18:52:43 user nova-compute[75634]:       <nova:ports>
Nov 15 18:52:43 user nova-compute[75634]:         <nova:port uuid="b7504859-c358-4e92-abe1-23f616a3049f">
Nov 15 18:52:43 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 18:52:43 user nova-compute[75634]:         </nova:port>
Nov 15 18:52:43 user nova-compute[75634]:       </nova:ports>
Nov 15 18:52:43 user nova-compute[75634]:     </nova:instance>
Nov 15 18:52:43 user nova-compute[75634]:   </metadata>
Nov 15 18:52:43 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:52:43 user nova-compute[75634]:     <system>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="serial">e703006a-80fb-438a-9bcb-3149a505a116</entry>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="uuid">e703006a-80fb-438a-9bcb-3149a505a116</entry>
Nov 15 18:52:43 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:52:43 user nova-compute[75634]:     </system>
Nov 15 18:52:43 user nova-compute[75634]:   </sysinfo>
Nov 15 18:52:43 user nova-compute[75634]:   <os>
Nov 15 18:52:43 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:52:43 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:52:43 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:52:43 user nova-compute[75634]:   </os>
Nov 15 18:52:43 user nova-compute[75634]:   <features>
Nov 15 18:52:43 user nova-compute[75634]:     <acpi/>
Nov 15 18:52:43 user nova-compute[75634]:     <apic/>
Nov 15 18:52:43 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:52:43 user nova-compute[75634]:   </features>
Nov 15 18:52:43 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:52:43 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:52:43 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:52:43 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:52:43 user nova-compute[75634]:   </clock>
Nov 15 18:52:43 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:52:43 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:52:43 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:52:43 user nova-compute[75634]:   </cpu>
Nov 15 18:52:43 user nova-compute[75634]:   <devices>
Nov 15 18:52:43 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:52:43 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:52:43 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk"/>
Nov 15 18:52:43 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:52:43 user nova-compute[75634]:     </disk>
Nov 15 18:52:43 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:52:43 user nova-compute[75634]:       <mac address="fa:16:3e:92:53:64"/>
Nov 15 18:52:43 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:52:43 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:52:43 user nova-compute[75634]:       <target dev="tapb7504859-c3"/>
Nov 15 18:52:43 user nova-compute[75634]:     </interface>
Nov 15 18:52:43 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:52:43 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/console.log" append="off"/>
Nov 15 18:52:43 user nova-compute[75634]:     </serial>
Nov 15 18:52:43 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:52:43 user nova-compute[75634]:     <video>
Nov 15 18:52:43 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:52:43 user nova-compute[75634]:     </video>
Nov 15 18:52:43 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:52:43 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:52:43 user nova-compute[75634]:     </rng>
Nov 15 18:52:43 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:52:43 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:52:43 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:52:43 user nova-compute[75634]:     </memballoon>
Nov 15 18:52:43 user nova-compute[75634]:   </devices>
Nov 15 18:52:43 user nova-compute[75634]: </domain>
Nov 15 18:52:43 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285570684',display_name='tempest-TestMinimumBasicScenario-server-285570684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285570684',id=40,image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA6erBWORk9is5A20OxR3sH2uEqngO6OE9qLuz4twB3AXcs3ChN1jOkVs2GtpiIzu9PhQTwf8qItmzrULCgmGObDC8+pslwxWCrF6gC+JDZqriPbmaCJDN2vd0ybP2CMg==',key_name='tempest-TestMinimumBasicScenario-318052602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-685emy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:52:41Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=e703006a-80fb-438a-9bcb-3149a505a116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG os_vif [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '927c4732-5fad-56c9-8e92-69b06bde18b0', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7504859-c3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7504859-c3, col_values=(('qos', UUID('cd1aa36b-44f4-4ea4-b46a-4f867f9413e6')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7504859-c3, col_values=(('external_ids', {'iface-id': 'b7504859-c358-4e92-abe1-23f616a3049f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:53:64', 'vm-uuid': 'e703006a-80fb-438a-9bcb-3149a505a116'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:43 user nova-compute[75634]: INFO os_vif [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3')
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No VIF found with MAC fa:16:3e:92:53:64, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updated VIF entry in instance network info cache for port b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-33975d78-7f0e-48b8-a1f2-d22c79ff91c1 req-032be494-9df1-4e05-9296-2e1992c82361 service nova] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:45 user nova-compute[75634]: WARNING nova.compute.manager [req-e30178f1-2b5f-48e8-832b-9c4b4e628e51 req-4615dcd5-1fbe-46df-a5b5-d66c04897ecf service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state building and task_state spawning.
Nov 15 18:52:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:52:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance spawned successfully.
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:52:46 user nova-compute[75634]: INFO nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 15 18:52:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:52:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:52:47 user nova-compute[75634]: WARNING nova.compute.manager [req-e3ae6df1-9e8f-4b80-8cf2-b8a47d75c7b5 req-652de3fb-73b6-456c-bcc4-13e75a5ff583 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state building and task_state spawning.
Nov 15 18:52:47 user nova-compute[75634]: INFO nova.compute.manager [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Took 6.57 seconds to build instance.
Nov 15 18:52:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fa0d6e71-2ae7-4ac3-9565-c44aa394d14b tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-changed-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Refreshing instance network info cache due to event network-changed-2ab0966b-93fd-48f0-86d8-f5b549e09ecb. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] Acquiring lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] Acquired lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:52:51 user nova-compute[75634]: DEBUG nova.network.neutron [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Refreshing network info cache for port 2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:52:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updated VIF entry in instance network info cache for port 2ab0966b-93fd-48f0-86d8-f5b549e09ecb. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:52:52 user nova-compute[75634]: DEBUG nova.network.neutron [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updating instance_info_cache with network_info: [{"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:52:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a8aa89e-e5c4-4de2-90fe-9f9cf0deff77 req-8762837b-b246-429d-b461-7182247d8c7c service nova] Releasing lock "refresh_cache-fe8f976c-9856-4fb4-82ff-14ad221ab044" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:52:53 user nova-compute[75634]: INFO nova.compute.manager [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Attaching volume bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 to /dev/vdb
Nov 15 18:52:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.utils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc06d5c-3805-4ab3-8027-7209772c239c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ff89a-ee41-4b44-8ee9-6224a79ec7f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9137afa-5006-4aea-9642-dff044f0e14c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d60711-45e0-422c-b7d9-edcd252070b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:52:53 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:52:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a4f9e0-eed1-4cba-ac80-1884eca7711b]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG os_brick.utils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:52:53 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updating existing volume attachment record: 2cd4d799-5b94-4ad0-8cd8-cb801bcb617c {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:52:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iztepJfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:52:58 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:52:58 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:52:58 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adee498-5a55-466f-ba0d-7d1e507b37e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:52:58 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65d110-233e-4de1-b129-132bb360d3c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3] added
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811e2f5-87a5-4734-9fa8-14728e566cfa]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5580f31-366c-40a1-8047-b7356f40e270]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iztepJfI {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iztepJfI" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e10ab3-cc39-4304-a7bd-71d6cf7124bd]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iztepJfI'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbfbdb1-73bd-4394-bc2b-58bb2d6ba55a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19aaef5-4fc4-4223-81be-123338e08c73]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d679072-e632-4106-a265-17064666c3a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260]
Nov 15 18:52:58 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260] successful.
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f1d285-db86-43f4-ade4-a0129f032ca9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a9597-b395-44c5-9061-719179fa8940]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:52:58 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:52:58 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e74d95-9956-493b-bd64-689c1abd7e4d]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:52:58 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iztepJfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23638386563333761', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638386563333761', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:52:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:52:59 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:52:59 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:52:59 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:52:59 user nova-compute[75634]:   <serial>bd9e8952-aef4-4124-bb77-71d8d8ee0ff3</serial>
Nov 15 18:52:59 user nova-compute[75634]: </disk>
Nov 15 18:52:59 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:53:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:53:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:53:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] No VIF found with MAC fa:16:3e:85:bc:65, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:53:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ad3015d-5d7f-4ffb-a6fe-9237d42e3d74 tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.957s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:01 user nova-compute[75634]: INFO nova.compute.manager [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Detaching volume bd9e8952-aef4-4124-bb77-71d8d8ee0ff3
Nov 15 18:53:01 user nova-compute[75634]: INFO nova.virt.block_device [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Attempting to driver detach volume bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 from mountpoint /dev/vdb
Nov 15 18:53:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Attempting to detach device vdb from instance fe8f976c-9856-4fb4-82ff-14ad221ab044 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:53:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:53:01 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:53:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:53:01 user nova-compute[75634]:   <serial>bd9e8952-aef4-4124-bb77-71d8d8ee0ff3</serial>
Nov 15 18:53:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:53:01 user nova-compute[75634]: </disk>
Nov 15 18:53:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:01 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance fe8f976c-9856-4fb4-82ff-14ad221ab044 from the persistent domain config.
Nov 15 18:53:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe8f976c-9856-4fb4-82ff-14ad221ab044 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:53:01 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:53:01 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 18:53:01 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:53:01 user nova-compute[75634]:   <serial>bd9e8952-aef4-4124-bb77-71d8d8ee0ff3</serial>
Nov 15 18:53:01 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:53:01 user nova-compute[75634]: </disk>
Nov 15 18:53:01 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:53:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:53:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:04 user nova-compute[75634]: INFO nova.compute.manager [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Terminating instance
Nov 15 18:53:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-unplugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] No waiting events found dispatching network-vif-unplugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6d98df0-bd36-428a-aa39-60a42f05c87c req-c6fb2585-fbcb-405f-8753-b1fc34c10780 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-unplugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Instance destroyed successfully.
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid 6d5895a2-9b07-44d1-8bb1-61290ac557e8 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1823427555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1823427555',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAR496uiDsFQpxThn1se9U2yq3qWt1EXzgEWMNpFAPrYJyocAiAzgtZLgMB4Kx3EkFbqa/uz/mjZ+cJWIVxvv2suYeBs4L3JALEpeo6wJJGaXBfggbUHuTWcR3USVIOLg==',key_name='tempest-keypair-1039034984',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-t12q4myr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:48:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=6d5895a2-9b07-44d1-8bb1-61290ac557e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "address": "fa:16:3e:e0:44:1f", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6260f948-41", "ovs_interfaceid": "6260f948-41fc-4b14-aae3-778f3c9cdb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_vif [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6260f948-41, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9ae4147-7939-4f6d-bab5-4e6341747663) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:05 user nova-compute[75634]: INFO os_vif [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=6260f948-41fc-4b14-aae3-778f3c9cdb1a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6260f948-41')
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzKSgDEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:53:05 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eea91d-eb4a-43aa-a144-f2e779968ae7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:53:05 user nova-compute[75634]: No targets found.
Nov 15 18:53:05 user nova-compute[75634]: iSNS:
Nov 15 18:53:05 user nova-compute[75634]: No targets found.
Nov 15 18:53:05 user nova-compute[75634]: STATIC:
Nov 15 18:53:05 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7
Nov 15 18:53:05 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:05 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:05 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3
Nov 15 18:53:05 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:05 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:05 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:53:05 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:05 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:05 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:53:05 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:05 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:05 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:53:05 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:05 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:05 user nova-compute[75634]: FIRMWARE:
Nov 15 18:53:05 user nova-compute[75634]: No targets found.
Nov 15 18:53:05 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:53:05 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:53:05 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e7bf23-f4df-4f57-a5e7-9b1c463d0acf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d10dfe-8cec-43d3-9d40-d2d7eaf379e9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:05 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:53:05 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b6848ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c46af74-1be2-453a-9584-29c6d1e3f1e0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a27706a-cbf0-4e82-9a69-7d9829fcaabb]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7ed23-a755-4673-9327-29fea89b0e2b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce193f3b-1df7-47d8-970d-d8486dba34df]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[089970bd-0e37-464e-923f-17d9e1cfd5e2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396e13e-7a41-40c6-a57b-9576a2f78198]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260]
Nov 15 18:53:05 user nova-compute[75634]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7, portal: 172.16.0.220,3260] successful.
Nov 15 18:53:05 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651d52d-d9b4-49ec-a093-f1e5129760e5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (333ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:53:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Deleting instance files /opt/stack/data/nova/instances/6d5895a2-9b07-44d1-8bb1-61290ac557e8_del
Nov 15 18:53:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Deletion of /opt/stack/data/nova/instances/6d5895a2-9b07-44d1-8bb1-61290ac557e8_del complete
Nov 15 18:53:05 user nova-compute[75634]: INFO nova.compute.manager [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 18:53:05 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:53:05 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:06 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Took 0.96 seconds to deallocate network for instance.
Nov 15 18:53:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-09c95fa2-3b50-4fb6-b883-ec5b501d79fb req-f2112a21-51f5-468f-8b44-ed33bb56fda6 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-deleted-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] Acquiring lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] No waiting events found dispatching network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:06 user nova-compute[75634]: WARNING nova.compute.manager [req-59b4c6ee-eb56-4ebb-89a9-ba340d6e3bc0 req-286236eb-96d0-43b0-be40-653f92715864 service nova] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Received unexpected event network-vif-plugged-6260f948-41fc-4b14-aae3-778f3c9cdb1a for instance with vm_state active and task_state deleting.
Nov 15 18:53:07 user nova-compute[75634]: INFO nova.compute.manager [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 18:53:07 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 6d5895a2-9b07-44d1-8bb1-61290ac557e8] Deleting volume: f8f4087c-d48c-42d2-bf2d-cfa58cde12a7 {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 18:53:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:07 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:53:07 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:53:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:07 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance 6d5895a2-9b07-44d1-8bb1-61290ac557e8
Nov 15 18:53:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fe1eddb4-c0e6-461f-a3c6-b9d2aafd94fe tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "6d5895a2-9b07-44d1-8bb1-61290ac557e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:20 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:53:20 user nova-compute[75634]: INFO nova.compute.claims [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Claim successful on node user
Nov 15 18:53:20 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:53:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:53:21 user nova-compute[75634]: INFO nova.virt.block_device [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Booting with volume-backed-image 2c2255c9-a9c5-4496-8a92-18849f2ce081 at /dev/vda
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.policy [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000d54e8a82d48b58f554ae085a4dab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17eb80780ad4231889417dab82ea2cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Successfully created port: bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:53:21 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe8f976c-9856-4fb4-82ff-14ad221ab044 is timed out.
Nov 15 18:53:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully detached device vdb from instance fe8f976c-9856-4fb4-82ff-14ad221ab044 from the live domain config.
Nov 15 18:53:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iztepJfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:53:21 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396ba45-d848-4de9-bb83-cf0be760980b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:53:21 user nova-compute[75634]: No targets found.
Nov 15 18:53:21 user nova-compute[75634]: iSNS:
Nov 15 18:53:21 user nova-compute[75634]: No targets found.
Nov 15 18:53:21 user nova-compute[75634]: STATIC:
Nov 15 18:53:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3
Nov 15 18:53:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:53:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:53:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:21 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:53:21 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:53:21 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:53:21 user nova-compute[75634]: FIRMWARE:
Nov 15 18:53:21 user nova-compute[75634]: No targets found.
Nov 15 18:53:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:53:21 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:53:21 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48eac99-a338-4fd1-a7b3-6557a87245c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f43456-687d-414b-9af0-48fab5c8d595]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:53:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:21 user nova-compute[75634]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 (non-flash)
Nov 15 18:53:21 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b443f41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c2426f-62e5-40cf-bfbd-5f597afe96b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492fd53-b8a8-4617-8d24-006c77a29a40]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d06e4a0-090f-4720-abf7-62354eaddcd7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:53:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdb708d-f32a-4f6e-8ae8-3a2f4580aa72]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259b0bc-69db-4491-9d89-94c339e03cc7]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3776361-7702-489c-a5e3-1111d8881b0f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260]
Nov 15 18:53:22 user nova-compute[75634]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3, portal: 172.16.0.220,3260] successful.
Nov 15 18:53:22 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9e8952-aef4-4124-bb77-71d8d8ee0ff3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a544f1-465b-4a76-a4b8-85f255eb1d00]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] <== disconnect_volume: return (329ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Successfully updated port: bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-changed-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Refreshing instance network info cache due to event network-changed-bb827498-b525-4a37-b08b-c7a26522cd93. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] Acquiring lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating instance_info_cache with network_info: [{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance network_info: |[{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] Acquired lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Refreshing network info cache for port bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'flavor' on Instance uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:53:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-57ebc594-af98-43c4-9c0b-036f7d99211c tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updated VIF entry in instance network info cache for port bb827498-b525-4a37-b08b-c7a26522cd93. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:53:23 user nova-compute[75634]: DEBUG nova.network.neutron [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating instance_info_cache with network_info: [{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d40a3901-1ce7-4e7f-8310-7e2e8dcbb190 req-c801d522-c910-44a7-82cf-09ddaf47c17b service nova] Releasing lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:53:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.utils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adccde-ef2c-43ad-b8cb-3c27055f7187]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[003720db-3c72-4f04-8edd-d2c144272a81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969c985-8507-43e6-acc2-da7cc398d538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67c97e-2498-439d-bbe2-068611e33b60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:53:26 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:53:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b753464d-9979-4113-b117-2345cab67b45]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG os_brick.utils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:53:26 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating existing volume attachment record: 7b4a74af-4b7c-467c-b793-9f09511bcbc2 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:53:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:53:32 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Creating image(s)
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Ensure instance console log exists: /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start _get_guest_xml network_info=[{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01dba5ab-f76c-4337-b544-342783f33418', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'serial': 'b1b48291-f4e1-4c7f-9d49-6679c0f7c613'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '7b4a74af-4b7c-467c-b793-9f09511bcbc2', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:53:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:32 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:53:32 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:53:32 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:53:32 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e59be-d456-44b3-95fa-a245a2ae292e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:53:32 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0f535a-3c4e-4976-9e1d-44a196ec63a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613] added
Nov 15 18:53:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0303ea-a05a-49db-9f51-fdc86c672979]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d865e1-3e2b-49e0-963f-32023f3b919b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:32 user nova-compute[75634]: INFO nova.compute.manager [None req-27770c86-ea94-4a81-aa69-6b4a7b161880 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Get console output
Nov 15 18:53:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJRTIGxs {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJRTIGxs" returned: 0 in 0.098s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e12577-afb4-40e4-a446-1be3e0ca7c35]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJRTIGxs'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5a946-d1d8-488a-b918-670458b53083]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b14ed-9142-4966-9eb4-c1a2e6e02d70]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df2bdc-10d7-43e7-b627-d0ef5a65f0bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260]
Nov 15 18:53:33 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260] successful.
Nov 15 18:53:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcdcc57-ddac-45f3-b00c-83e8028a9a54]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf6b45-e3cb-4209-b5e4-6a3416910ddc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:53:33 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:53:33 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d8ef7-f1f3-4b6c-8a8a-0ffc30e54939]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23632613130613430', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632613130613430', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348165560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348165560',id=41,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-a72ygr20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:21Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=01dba5ab-f76c-4337-b544-342783f33418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:53:34 user nova-compute[75634]:   <uuid>01dba5ab-f76c-4337-b544-342783f33418</uuid>
Nov 15 18:53:34 user nova-compute[75634]:   <name>instance-00000029</name>
Nov 15 18:53:34 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:53:34 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:53:34 user nova-compute[75634]:   <metadata>
Nov 15 18:53:34 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:53:34 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-348165560</nova:name>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:53:32</nova:creationTime>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:53:34 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:53:34 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:owner>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:53:34 user nova-compute[75634]:       </nova:owner>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:53:34 user nova-compute[75634]:       <nova:ports>
Nov 15 18:53:34 user nova-compute[75634]:         <nova:port uuid="bb827498-b525-4a37-b08b-c7a26522cd93">
Nov 15 18:53:34 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 18:53:34 user nova-compute[75634]:         </nova:port>
Nov 15 18:53:34 user nova-compute[75634]:       </nova:ports>
Nov 15 18:53:34 user nova-compute[75634]:     </nova:instance>
Nov 15 18:53:34 user nova-compute[75634]:   </metadata>
Nov 15 18:53:34 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:53:34 user nova-compute[75634]:     <system>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="serial">01dba5ab-f76c-4337-b544-342783f33418</entry>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="uuid">01dba5ab-f76c-4337-b544-342783f33418</entry>
Nov 15 18:53:34 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:53:34 user nova-compute[75634]:     </system>
Nov 15 18:53:34 user nova-compute[75634]:   </sysinfo>
Nov 15 18:53:34 user nova-compute[75634]:   <os>
Nov 15 18:53:34 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:53:34 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:53:34 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:53:34 user nova-compute[75634]:   </os>
Nov 15 18:53:34 user nova-compute[75634]:   <features>
Nov 15 18:53:34 user nova-compute[75634]:     <acpi/>
Nov 15 18:53:34 user nova-compute[75634]:     <apic/>
Nov 15 18:53:34 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:53:34 user nova-compute[75634]:   </features>
Nov 15 18:53:34 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:53:34 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:53:34 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:53:34 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:53:34 user nova-compute[75634]:   </clock>
Nov 15 18:53:34 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:53:34 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:53:34 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:53:34 user nova-compute[75634]:   </cpu>
Nov 15 18:53:34 user nova-compute[75634]:   <devices>
Nov 15 18:53:34 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:53:34 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:53:34 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:53:34 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:53:34 user nova-compute[75634]:       <serial>b1b48291-f4e1-4c7f-9d49-6679c0f7c613</serial>
Nov 15 18:53:34 user nova-compute[75634]:     </disk>
Nov 15 18:53:34 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:53:34 user nova-compute[75634]:       <mac address="fa:16:3e:8c:e4:dd"/>
Nov 15 18:53:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:53:34 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:53:34 user nova-compute[75634]:       <target dev="tapbb827498-b5"/>
Nov 15 18:53:34 user nova-compute[75634]:     </interface>
Nov 15 18:53:34 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:53:34 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/console.log" append="off"/>
Nov 15 18:53:34 user nova-compute[75634]:     </serial>
Nov 15 18:53:34 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:53:34 user nova-compute[75634]:     <video>
Nov 15 18:53:34 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:53:34 user nova-compute[75634]:     </video>
Nov 15 18:53:34 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:53:34 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:53:34 user nova-compute[75634]:     </rng>
Nov 15 18:53:34 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:53:34 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:53:34 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:53:34 user nova-compute[75634]:     </memballoon>
Nov 15 18:53:34 user nova-compute[75634]:   </devices>
Nov 15 18:53:34 user nova-compute[75634]: </domain>
Nov 15 18:53:34 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348165560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348165560',id=41,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-a72ygr20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:21Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=01dba5ab-f76c-4337-b544-342783f33418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG os_vif [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26123a76-1635-50d8-9c9d-0f25c94e7df5', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb827498-b5, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb827498-b5, col_values=(('qos', UUID('25ac84b5-b8ea-45e6-8872-e46ad3b60152')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb827498-b5, col_values=(('external_ids', {'iface-id': 'bb827498-b525-4a37-b08b-c7a26522cd93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e4:dd', 'vm-uuid': '01dba5ab-f76c-4337-b544-342783f33418'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:34 user nova-compute[75634]: INFO os_vif [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5')
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:8c:e4:dd, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:53:35 user nova-compute[75634]: INFO nova.compute.claims [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Claim successful on node user
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:53:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.policy [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395915213ac442edbdd3d80e03367744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfe1f0276a74611b6cf863fa909aa61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:35 user nova-compute[75634]: WARNING nova.compute.manager [req-b5277f66-8fd7-4f85-900f-85ce6b272769 req-5a6b856e-4c06-4175-a5a5-e243e7890be0 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state building and task_state spawning.
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:53:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Creating image(s)
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:38 user nova-compute[75634]: WARNING nova.compute.manager [req-0c5175ac-93e6-4656-8bba-16fb3678df4c req-58283cc6-aada-4ff2-a902-00ca07a42952 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state building and task_state spawning.
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:53:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=24.850120544433594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance spawned successfully.
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:38 user nova-compute[75634]: INFO nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 6903a62f-7273-4616-9f37-a072c7e47c48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance fe8f976c-9856-4fb4-82ff-14ad221ab044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e703006a-80fb-438a-9bcb-3149a505a116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:53:38 user nova-compute[75634]: INFO nova.compute.manager [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Took 17.92 seconds to build instance.
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8303991a-9e3e-471a-a04f-27b5869087c8 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.012s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk 1073741824" returned: 0 in 0.059s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Successfully created port: 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:53:38 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Cannot resize image /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Ensure instance console log exists: /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Successfully updated port: 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing instance network info cache due to event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.neutron [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance network_info: |[{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start _get_guest_xml network_info=[{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:53:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-279912819',display_name='tempest-ServerRescueNegativeTestJSON-server-279912819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-279912819',id=42,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKe6FRSwbyKr2hLUmb5k1aqFzWqHw3DorcgFPnimfcB12lUevYE7nsW5gi9GbXPJLE4rOEGbYKFOBAWecQwe+6E+Y728lkjEOJXDrB3GHvrRY3mwii7/u+M4XX4NXEKhg==',key_name='tempest-keypair-425341621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-98227wgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395915213ac442edbdd3d80e03367744',uuid=538aaff2-3904-4638-a624-36c9fee87a2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:53:39 user nova-compute[75634]:   <uuid>538aaff2-3904-4638-a624-36c9fee87a2d</uuid>
Nov 15 18:53:39 user nova-compute[75634]:   <name>instance-0000002a</name>
Nov 15 18:53:39 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:53:39 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:53:39 user nova-compute[75634]:   <metadata>
Nov 15 18:53:39 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:53:39 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-279912819</nova:name>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:53:39</nova:creationTime>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:53:39 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:53:39 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:owner>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:53:39 user nova-compute[75634]:       </nova:owner>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:53:39 user nova-compute[75634]:       <nova:ports>
Nov 15 18:53:39 user nova-compute[75634]:         <nova:port uuid="01cc67d7-ff33-4c0b-a21f-ebb0890d3686">
Nov 15 18:53:39 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:53:39 user nova-compute[75634]:         </nova:port>
Nov 15 18:53:39 user nova-compute[75634]:       </nova:ports>
Nov 15 18:53:39 user nova-compute[75634]:     </nova:instance>
Nov 15 18:53:39 user nova-compute[75634]:   </metadata>
Nov 15 18:53:39 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:53:39 user nova-compute[75634]:     <system>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="serial">538aaff2-3904-4638-a624-36c9fee87a2d</entry>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="uuid">538aaff2-3904-4638-a624-36c9fee87a2d</entry>
Nov 15 18:53:39 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:53:39 user nova-compute[75634]:     </system>
Nov 15 18:53:39 user nova-compute[75634]:   </sysinfo>
Nov 15 18:53:39 user nova-compute[75634]:   <os>
Nov 15 18:53:39 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:53:39 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:53:39 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:53:39 user nova-compute[75634]:   </os>
Nov 15 18:53:39 user nova-compute[75634]:   <features>
Nov 15 18:53:39 user nova-compute[75634]:     <acpi/>
Nov 15 18:53:39 user nova-compute[75634]:     <apic/>
Nov 15 18:53:39 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:53:39 user nova-compute[75634]:   </features>
Nov 15 18:53:39 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:53:39 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:53:39 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:53:39 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:53:39 user nova-compute[75634]:   </clock>
Nov 15 18:53:39 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:53:39 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:53:39 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:53:39 user nova-compute[75634]:   </cpu>
Nov 15 18:53:39 user nova-compute[75634]:   <devices>
Nov 15 18:53:39 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:53:39 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:53:39 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk"/>
Nov 15 18:53:39 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:53:39 user nova-compute[75634]:     </disk>
Nov 15 18:53:39 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:53:39 user nova-compute[75634]:       <mac address="fa:16:3e:28:b4:7b"/>
Nov 15 18:53:39 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:53:39 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:53:39 user nova-compute[75634]:       <target dev="tap01cc67d7-ff"/>
Nov 15 18:53:39 user nova-compute[75634]:     </interface>
Nov 15 18:53:39 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:53:39 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/console.log" append="off"/>
Nov 15 18:53:39 user nova-compute[75634]:     </serial>
Nov 15 18:53:39 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:53:39 user nova-compute[75634]:     <video>
Nov 15 18:53:39 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:53:39 user nova-compute[75634]:     </video>
Nov 15 18:53:39 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:53:39 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:53:39 user nova-compute[75634]:     </rng>
Nov 15 18:53:39 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:53:39 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:53:39 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:53:39 user nova-compute[75634]:     </memballoon>
Nov 15 18:53:39 user nova-compute[75634]:   </devices>
Nov 15 18:53:39 user nova-compute[75634]: </domain>
Nov 15 18:53:39 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-279912819',display_name='tempest-ServerRescueNegativeTestJSON-server-279912819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-279912819',id=42,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKe6FRSwbyKr2hLUmb5k1aqFzWqHw3DorcgFPnimfcB12lUevYE7nsW5gi9GbXPJLE4rOEGbYKFOBAWecQwe+6E+Y728lkjEOJXDrB3GHvrRY3mwii7/u+M4XX4NXEKhg==',key_name='tempest-keypair-425341621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-98227wgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395915213ac442edbdd3d80e03367744',uuid=538aaff2-3904-4638-a624-36c9fee87a2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG os_vif [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '537fa91c-daa0-55a3-a279-1adaa68cf609', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01cc67d7-ff, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01cc67d7-ff, col_values=(('qos', UUID('08da0f76-5e6a-4011-b3e2-c751b6249aff')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01cc67d7-ff, col_values=(('external_ids', {'iface-id': '01cc67d7-ff33-4c0b-a21f-ebb0890d3686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b4:7b', 'vm-uuid': '538aaff2-3904-4638-a624-36c9fee87a2d'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:39 user nova-compute[75634]: INFO os_vif [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff')
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:28:b4:7b, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updated VIF entry in instance network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1200038-84b8-42e5-8c9b-84385acce8b1 req-1debe56f-7bb8-449f-8783-9a91af941319 service nova] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:41 user nova-compute[75634]: WARNING nova.compute.manager [req-efa6e6cb-8f43-455a-98e1-025e65afa340 req-7d16da6e-585a-4499-92c9-f28b010b5d97 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state building and task_state spawning.
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:53:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance spawned successfully.
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:43 user nova-compute[75634]: WARNING nova.compute.manager [req-56fa5c05-3f56-4c52-b5c1-3f71eca4954a req-6c0ec67a-e4f4-4566-909f-99ff7e75f469 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state building and task_state spawning.
Nov 15 18:53:43 user nova-compute[75634]: INFO nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 15 18:53:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:53:43 user nova-compute[75634]: INFO nova.compute.manager [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Took 8.74 seconds to build instance.
Nov 15 18:53:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3661afcf-b7b6-45e1-8049-cb36151dba3b tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.839s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid b44cd307-ffbe-4ccd-996f-299ce61b60a6 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 6903a62f-7273-4616-9f37-a072c7e47c48 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid d324a863-5fde-4342-815f-da9a158d5df7 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "d324a863-5fde-4342-815f-da9a158d5df7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "01dba5ab-f76c-4337-b544-342783f33418" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "d324a863-5fde-4342-815f-da9a158d5df7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "01dba5ab-f76c-4337-b544-342783f33418" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:51 user nova-compute[75634]: INFO nova.compute.manager [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Terminating instance
Nov 15 18:53:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-unplugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] No waiting events found dispatching network-vif-unplugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.compute.manager [req-69b5e7f5-961e-4cbe-8a8c-35ae2576fcd6 req-20ccaa7c-ce23-41bd-9cd3-e7ab32da3272 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-unplugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:53:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Instance destroyed successfully.
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lazy-loading 'resources' on Instance uuid fe8f976c-9856-4fb4-82ff-14ad221ab044 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453599867',display_name='tempest-AttachVolumeNegativeTest-server-453599867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453599867',id=39,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXhfTGktz1OkKFDiWyriej8fmjzdbOQrIruwkb7DA67Q1pBiresuWDBMw35K5dJPP+rWgX+0laN7ra7m91NRp/Z/tgAXUAx1KCKzSuWdzTiosHnteZ29RZRKuwTkCmPkg==',key_name='tempest-keypair-101845244',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b1bd5fcf764dbda726e347edd1e63a',ramdisk_id='',reservation_id='r-x008pn5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1838989545',owner_user_name='tempest-AttachVolumeNegativeTest-1838989545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:51:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a54ff6670dd74beea8b818f8cbd2e93c',uuid=fe8f976c-9856-4fb4-82ff-14ad221ab044,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converting VIF {"id": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "address": "fa:16:3e:85:bc:65", "network": {"id": "dd325880-d53b-4af2-bb31-cc2a5c8e2f4e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1371759544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b1bd5fcf764dbda726e347edd1e63a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab0966b-93", "ovs_interfaceid": "2ab0966b-93fd-48f0-86d8-f5b549e09ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG os_vif [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab0966b-93, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cf3010f-a2ad-4399-a7dd-f80fad4ec443) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:52 user nova-compute[75634]: INFO os_vif [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:bc:65,bridge_name='br-int',has_traffic_filtering=True,id=2ab0966b-93fd-48f0-86d8-f5b549e09ecb,network=Network(dd325880-d53b-4af2-bb31-cc2a5c8e2f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab0966b-93')
Nov 15 18:53:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Deleting instance files /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044_del
Nov 15 18:53:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Deletion of /opt/stack/data/nova/instances/fe8f976c-9856-4fb4-82ff-14ad221ab044_del complete
Nov 15 18:53:52 user nova-compute[75634]: INFO nova.compute.manager [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 18:53:52 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:53:52 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:53:53 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:53:53 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Took 1.02 seconds to deallocate network for instance.
Nov 15 18:53:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:53 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:53:53 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:54 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Deleted allocations for instance fe8f976c-9856-4fb4-82ff-14ad221ab044
Nov 15 18:53:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bdd7231c-490f-4741-a4f4-b2d2636816ed tempest-AttachVolumeNegativeTest-1838989545 tempest-AttachVolumeNegativeTest-1838989545-project-member] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] Acquiring lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] Lock "fe8f976c-9856-4fb4-82ff-14ad221ab044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:53:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] No waiting events found dispatching network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:53:54 user nova-compute[75634]: WARNING nova.compute.manager [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received unexpected event network-vif-plugged-2ab0966b-93fd-48f0-86d8-f5b549e09ecb for instance with vm_state deleted and task_state None.
Nov 15 18:53:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3b9dab5-a7b0-4ae4-bfe2-9fc70864dfbc req-a88fdb91-e170-4d11-851a-91aa1450ace9 service nova] [instance: fe8f976c-9856-4fb4-82ff-14ad221ab044] Received event network-vif-deleted-2ab0966b-93fd-48f0-86d8-f5b549e09ecb {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:53:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:53:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:54:02 user nova-compute[75634]: INFO nova.compute.claims [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Claim successful on node user
Nov 15 18:54:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:54:02 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:54:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG nova.policy [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:54:03 user nova-compute[75634]: INFO nova.virt.block_device [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Booting with volume 1dca3e22-a600-43ab-b92f-48c0e821d092 at /dev/vda
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.utils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9745db6-abce-4e55-8aaf-b7aea8f69acd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[543e352c-840e-4607-8e87-a83273b0d565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5353591b-d8a3-432a-8814-87e922cc049d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f324d-b791-4817-b0e8-e68ef4c26d5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:54:03 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:54:03 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eca8ee-cfed-491b-a7cc-4cb69e670587]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG os_brick.utils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updating existing volume attachment record: 0223579c-8402-4dc7-ad2f-b32065a8c180 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:54:03 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Successfully created port: 468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Successfully updated port: 468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-changed-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Refreshing instance network info cache due to event network-changed-468e47db-6145-43d7-a361-44dea5792a3a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] Acquiring lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.network.neutron [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updating instance_info_cache with network_info: [{"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Instance network_info: |[{"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] Acquired lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:04 user nova-compute[75634]: DEBUG nova.network.neutron [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Refreshing network info cache for port 468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:54:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updated VIF entry in instance network info cache for port 468e47db-6145-43d7-a361-44dea5792a3a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:54:05 user nova-compute[75634]: DEBUG nova.network.neutron [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updating instance_info_cache with network_info: [{"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d890a322-3fd3-46b0-af1b-8c8d6ca8b9f9 req-01bf2dc0-6013-4681-a4b8-ad8cc0565719 service nova] Releasing lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:54:08 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Creating image(s)
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Ensure instance console log exists: /opt/stack/data/nova/instances/8dba2413-c35a-4a8d-811c-0cbf75b503b1/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Start _get_guest_xml network_info=[{"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8dba2413-c35a-4a8d-811c-0cbf75b503b1', 'attached_at': '', 'detached_at': '', 'volume_id': '1dca3e22-a600-43ab-b92f-48c0e821d092', 'serial': '1dca3e22-a600-43ab-b92f-48c0e821d092'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '0223579c-8402-4dc7-ad2f-b32065a8c180', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:54:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:08 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:08 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:08 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:08 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8f729-8896-440f-9d71-db088ef67d8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:54:08 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56251821-d309-4faf-be96-0510842255ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092] added
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb2e90-2585-4099-8037-ded5f98bee73]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76a446-e6a5-4196-b5fa-f2666cf747db]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQNPtenv {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQNPtenv" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037eaa6-7a3a-4c06-83cd-94ad54467262]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQNPtenv'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1878f7c7-64a5-46e7-aea7-248bbba39312]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4f2ada-f792-4167-b145-79fc062a4304]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a86b52-0408-4901-9fd0-051a8dfea4d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]
Nov 15 18:54:08 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1250282f-f33f-42d5-82c7-bea2e56d927e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f1d3c9-cfdf-43b6-af91-6820d25c9e28]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('37', '-', '-', 0) found on session 52 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e047127c-8ae7-476d-bfe7-d368b72603e6]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 52 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:54:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23166336334663033', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166336334663033', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1672375050',display_name='tempest-TestVolumeBootPattern-server-1672375050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1672375050',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-qzhm872s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:54:03Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=8dba2413-c35a-4a8d-811c-0cbf75b503b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dba2413-c35a-4a8d-811c-0cbf75b503b1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:54:09 user nova-compute[75634]:   <uuid>8dba2413-c35a-4a8d-811c-0cbf75b503b1</uuid>
Nov 15 18:54:09 user nova-compute[75634]:   <name>instance-0000002b</name>
Nov 15 18:54:09 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:54:09 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:54:09 user nova-compute[75634]:   <metadata>
Nov 15 18:54:09 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:54:09 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:54:09 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-server-1672375050</nova:name>
Nov 15 18:54:09 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:54:08</nova:creationTime>
Nov 15 18:54:09 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:54:09 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:54:09 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:54:09 user nova-compute[75634]:       <nova:owner>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:54:09 user nova-compute[75634]:       </nova:owner>
Nov 15 18:54:09 user nova-compute[75634]:       <nova:ports>
Nov 15 18:54:09 user nova-compute[75634]:         <nova:port uuid="468e47db-6145-43d7-a361-44dea5792a3a">
Nov 15 18:54:09 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:54:09 user nova-compute[75634]:         </nova:port>
Nov 15 18:54:09 user nova-compute[75634]:       </nova:ports>
Nov 15 18:54:09 user nova-compute[75634]:     </nova:instance>
Nov 15 18:54:09 user nova-compute[75634]:   </metadata>
Nov 15 18:54:09 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:54:09 user nova-compute[75634]:     <system>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="serial">8dba2413-c35a-4a8d-811c-0cbf75b503b1</entry>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="uuid">8dba2413-c35a-4a8d-811c-0cbf75b503b1</entry>
Nov 15 18:54:09 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:54:09 user nova-compute[75634]:     </system>
Nov 15 18:54:09 user nova-compute[75634]:   </sysinfo>
Nov 15 18:54:09 user nova-compute[75634]:   <os>
Nov 15 18:54:09 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:54:09 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:54:09 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:54:09 user nova-compute[75634]:   </os>
Nov 15 18:54:09 user nova-compute[75634]:   <features>
Nov 15 18:54:09 user nova-compute[75634]:     <acpi/>
Nov 15 18:54:09 user nova-compute[75634]:     <apic/>
Nov 15 18:54:09 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:54:09 user nova-compute[75634]:   </features>
Nov 15 18:54:09 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:54:09 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:54:09 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:54:09 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:54:09 user nova-compute[75634]:   </clock>
Nov 15 18:54:09 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:54:09 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:54:09 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:54:09 user nova-compute[75634]:   </cpu>
Nov 15 18:54:09 user nova-compute[75634]:   <devices>
Nov 15 18:54:09 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:54:09 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:54:09 user nova-compute[75634]:       <source dev="/dev/sdf"/>
Nov 15 18:54:09 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:54:09 user nova-compute[75634]:       <serial>1dca3e22-a600-43ab-b92f-48c0e821d092</serial>
Nov 15 18:54:09 user nova-compute[75634]:     </disk>
Nov 15 18:54:09 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:54:09 user nova-compute[75634]:       <mac address="fa:16:3e:e5:32:14"/>
Nov 15 18:54:09 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:54:09 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:54:09 user nova-compute[75634]:       <target dev="tap468e47db-61"/>
Nov 15 18:54:09 user nova-compute[75634]:     </interface>
Nov 15 18:54:09 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:54:09 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/8dba2413-c35a-4a8d-811c-0cbf75b503b1/console.log" append="off"/>
Nov 15 18:54:09 user nova-compute[75634]:     </serial>
Nov 15 18:54:09 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:54:09 user nova-compute[75634]:     <video>
Nov 15 18:54:09 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:54:09 user nova-compute[75634]:     </video>
Nov 15 18:54:09 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:54:09 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:54:09 user nova-compute[75634]:     </rng>
Nov 15 18:54:09 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:54:09 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:54:09 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:54:09 user nova-compute[75634]:     </memballoon>
Nov 15 18:54:09 user nova-compute[75634]:   </devices>
Nov 15 18:54:09 user nova-compute[75634]: </domain>
Nov 15 18:54:09 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1672375050',display_name='tempest-TestVolumeBootPattern-server-1672375050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1672375050',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-qzhm872s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:54:03Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=8dba2413-c35a-4a8d-811c-0cbf75b503b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG os_vif [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f77c57ae-86b1-5819-9ced-9cc6f97f3bca', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap468e47db-61, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap468e47db-61, col_values=(('qos', UUID('be9fb143-251b-449c-a545-cff69fe06814')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap468e47db-61, col_values=(('external_ids', {'iface-id': '468e47db-6145-43d7-a361-44dea5792a3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:32:14', 'vm-uuid': '8dba2413-c35a-4a8d-811c-0cbf75b503b1'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:09 user nova-compute[75634]: INFO os_vif [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61')
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:54:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:e5:32:14, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:54:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] No waiting events found dispatching network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:11 user nova-compute[75634]: WARNING nova.compute.manager [req-568b7d00-9981-4f04-aa6a-e8bba0fc12cc req-121c8a6e-ad2f-43b9-9d0d-347adb0bd157 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received unexpected event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a for instance with vm_state building and task_state spawning.
Nov 15 18:54:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:54:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Instance spawned successfully.
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:54:13 user nova-compute[75634]: INFO nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:13 user nova-compute[75634]: DEBUG nova.compute.manager [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] No waiting events found dispatching network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:13 user nova-compute[75634]: WARNING nova.compute.manager [req-216d75ad-a828-483e-a544-24c4186dafb2 req-2630139a-62cc-434f-b844-4a366b319df0 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received unexpected event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a for instance with vm_state building and task_state spawning.
Nov 15 18:54:13 user nova-compute[75634]: INFO nova.compute.manager [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Took 10.85 seconds to build instance.
Nov 15 18:54:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a7f6651e-5d27-4c7d-8b86-d9b591e558ce tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.939s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:54:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquired lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG nova.network.neutron [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'info_cache' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:54:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.network.neutron [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Releasing lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance destroyed successfully.
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'resources' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcfb27d8-ed, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c40c7dc7-e9c3-4729-a45c-df7e861e604a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:30 user nova-compute[75634]: INFO os_vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:30 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[70705448-be1a-4e91-88b2-a4bce30f6f01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:54:30 user nova-compute[75634]: No targets found.
Nov 15 18:54:30 user nova-compute[75634]: iSNS:
Nov 15 18:54:30 user nova-compute[75634]: No targets found.
Nov 15 18:54:30 user nova-compute[75634]: STATIC:
Nov 15 18:54:30 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:54:30 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:30 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:30 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:54:30 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:30 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:30 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:54:30 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:30 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:30 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:54:30 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:30 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:30 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:54:30 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:30 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:30 user nova-compute[75634]: FIRMWARE:
Nov 15 18:54:30 user nova-compute[75634]: No targets found.
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:54:30 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:54:30 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9077368-ec42-4156-81bb-e12044a281fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f787ef-4869-4d6a-8924-46e175131eab]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b683dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee411cb-a632-4f84-a83f-3b9e716692b2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd8524-8971-42d7-9de8-b07c0d7229a8]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f837c2-2ddf-4de2-9fb8-7684949892e0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2144b29-0fef-419e-a54c-1e825e7b56bd]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc96ed9-3467-49f7-95c9-21da33678bda]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac09b87-3723-498b-92f8-9a4777b7773f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]
Nov 15 18:54:30 user nova-compute[75634]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a1dfa-264d-4486-9d3c-49754a868280]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== disconnect_volume: return (348ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start _get_guest_xml network_info=[{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6', 'attached_at': '', 'detached_at': '', 'volume_id': '22b7f92c-945d-4e23-be2b-59c467cd540b', 'serial': '22b7f92c-945d-4e23-be2b-59c467cd540b'}, 'guest_format': None, 'boot_index': None, 'attachment_id': 'a2e9b0b0-775d-4219-bb96-dd9133fd82d8', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:30 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:30 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:30 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:30 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:30 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6400742-1c4d-4702-ac9e-0cadbe7165ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:54:30 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2db542-2310-486d-a15d-d00d9cd897a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b] added
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db95eef5-5f2b-4b92-b31e-be47b95b948b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1fc2aa-c499-4432-a335-afd726595a99]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYjwbIc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYjwbIc" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff1abb-5312-4aef-8291-be50830d3054]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exYjwbIc'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf775da-0b75-4609-aa1e-f5977e3ec4af]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61c498-04df-4fd8-b42f-fb882a35b02b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[076a7e62-9e51-448d-8f5e-0675198d6580]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]
Nov 15 18:54:31 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.
Nov 15 18:54:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1456233-7b7e-493a-aed2-5589b0f99212]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[952df07a-6524-401e-9db7-380de345dc62]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:31 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:31 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dad781f-dcb0-4df6-94c2-3dee7ab3c8cc]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23264613433613136', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264613433613136', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:54:32 user nova-compute[75634]:   <uuid>1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</uuid>
Nov 15 18:54:32 user nova-compute[75634]:   <name>instance-00000026</name>
Nov 15 18:54:32 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:54:32 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:54:32 user nova-compute[75634]:   <metadata>
Nov 15 18:54:32 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:54:32 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeTestJSON-server-643925418</nova:name>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:54:30</nova:creationTime>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:54:32 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:54:32 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:owner>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:user uuid="89755cafe30b4013b0642283a83bab00">tempest-AttachVolumeTestJSON-915928723-project-member</nova:user>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:project uuid="812d9a6afc424b4eb1e6d50d3035531a">tempest-AttachVolumeTestJSON-915928723</nova:project>
Nov 15 18:54:32 user nova-compute[75634]:       </nova:owner>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:54:32 user nova-compute[75634]:       <nova:ports>
Nov 15 18:54:32 user nova-compute[75634]:         <nova:port uuid="dcfb27d8-ed70-4d06-a254-0dd85a62cde1">
Nov 15 18:54:32 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:54:32 user nova-compute[75634]:         </nova:port>
Nov 15 18:54:32 user nova-compute[75634]:       </nova:ports>
Nov 15 18:54:32 user nova-compute[75634]:     </nova:instance>
Nov 15 18:54:32 user nova-compute[75634]:   </metadata>
Nov 15 18:54:32 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:54:32 user nova-compute[75634]:     <system>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="serial">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="uuid">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:54:32 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:54:32 user nova-compute[75634]:     </system>
Nov 15 18:54:32 user nova-compute[75634]:   </sysinfo>
Nov 15 18:54:32 user nova-compute[75634]:   <os>
Nov 15 18:54:32 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:54:32 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:54:32 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:54:32 user nova-compute[75634]:   </os>
Nov 15 18:54:32 user nova-compute[75634]:   <features>
Nov 15 18:54:32 user nova-compute[75634]:     <acpi/>
Nov 15 18:54:32 user nova-compute[75634]:     <apic/>
Nov 15 18:54:32 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:54:32 user nova-compute[75634]:   </features>
Nov 15 18:54:32 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:54:32 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:54:32 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:54:32 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:54:32 user nova-compute[75634]:   </clock>
Nov 15 18:54:32 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:54:32 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:54:32 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:54:32 user nova-compute[75634]:   </cpu>
Nov 15 18:54:32 user nova-compute[75634]:   <devices>
Nov 15 18:54:32 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:54:32 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:54:32 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk"/>
Nov 15 18:54:32 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:54:32 user nova-compute[75634]:     </disk>
Nov 15 18:54:32 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:54:32 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:54:32 user nova-compute[75634]:       <source dev="/dev/sde"/>
Nov 15 18:54:32 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:54:32 user nova-compute[75634]:       <serial>22b7f92c-945d-4e23-be2b-59c467cd540b</serial>
Nov 15 18:54:32 user nova-compute[75634]:     </disk>
Nov 15 18:54:32 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:54:32 user nova-compute[75634]:       <mac address="fa:16:3e:d2:0b:cc"/>
Nov 15 18:54:32 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:54:32 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:54:32 user nova-compute[75634]:       <target dev="tapdcfb27d8-ed"/>
Nov 15 18:54:32 user nova-compute[75634]:     </interface>
Nov 15 18:54:32 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:54:32 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/console.log" append="off"/>
Nov 15 18:54:32 user nova-compute[75634]:     </serial>
Nov 15 18:54:32 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:54:32 user nova-compute[75634]:     <video>
Nov 15 18:54:32 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:54:32 user nova-compute[75634]:     </video>
Nov 15 18:54:32 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:54:32 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:54:32 user nova-compute[75634]:     </rng>
Nov 15 18:54:32 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:54:32 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:54:32 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:54:32 user nova-compute[75634]:     </memballoon>
Nov 15 18:54:32 user nova-compute[75634]:   </devices>
Nov 15 18:54:32 user nova-compute[75634]: </domain>
Nov 15 18:54:32 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:32 user nova-compute[75634]: INFO nova.compute.manager [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Attaching volume 1da0aef3-66be-4c5c-8c78-7e7cf74e5bac to /dev/vdb
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Cannot resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.instance [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'migration_context' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.objects.base [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bb5d7f1-8f54-5416-9165-4fc3c71e251e', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG os_brick.utils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcfb27d8-ed, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcfb27d8-ed, col_values=(('qos', UUID('439b53ae-99ed-4015-bf1d-60447939ed3a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcfb27d8-ed, col_values=(('external_ids', {'iface-id': 'dcfb27d8-ed70-4d06-a254-0dd85a62cde1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0b:cc', 'vm-uuid': '1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[080fdcb2-eb77-42ec-929c-cc48be10bc52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:32 user nova-compute[75634]: INFO os_vif [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45fa33-6a5d-4682-ab98-9d5a0255ca57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35175e-85cd-4ae7-a12b-6598a8b2cd0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[070cf237-3b8d-4e19-9c58-c281f9a085df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:54:33 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71886eb-9d98-44b4-b7e5-213b501dba68]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG os_brick.utils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating existing volume attachment record: b4df00b2-94ea-4121-a522-37b939716455 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:33 user nova-compute[75634]: INFO nova.compute.manager [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Terminating instance
Nov 15 18:54:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-b26a563a-84a7-4887-aa0f-70b0baf477e8 req-43a386c8-9f1b-4cfd-a3c3-73a83c66b61e service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-unplugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:34 user nova-compute[75634]: WARNING nova.compute.manager [req-f40aaaa6-1471-47f2-b7cb-29e393955b2e req-618010b1-9ac9-4b7f-a16e-b0e9ceb9f4f9 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state stopped and task_state powering-on.
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Instance destroyed successfully.
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'resources' on Instance uuid 6903a62f-7273-4616-9f37-a072c7e47c48 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1783177436',display_name='tempest-ServerActionsTestOtherA-server-1783177436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1783177436',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-znjvg1v3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=6903a62f-7273-4616-9f37-a072c7e47c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "address": "fa:16:3e:5b:2b:88", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b2f8a3e-2a", "ovs_interfaceid": "3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG os_vif [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b2f8a3e-2a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=543e77c8-ca23-4c97-a490-d2a896c38f64) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: INFO os_vif [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:2b:88,bridge_name='br-int',has_traffic_filtering=True,id=3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b2f8a3e-2a')
Nov 15 18:54:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syMdZPat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:35 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e19faf-f0b5-4018-865e-e2c1d887fd94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:54:35 user nova-compute[75634]: No targets found.
Nov 15 18:54:35 user nova-compute[75634]: iSNS:
Nov 15 18:54:35 user nova-compute[75634]: No targets found.
Nov 15 18:54:35 user nova-compute[75634]: STATIC:
Nov 15 18:54:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:54:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec
Nov 15 18:54:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:54:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:54:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:54:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:54:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:54:35 user nova-compute[75634]: FIRMWARE:
Nov 15 18:54:35 user nova-compute[75634]: No targets found.
Nov 15 18:54:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:54:35 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:54:35 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a7f994-4406-4a7e-b086-ab05cc95e7c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988e658-113b-4679-b75d-921306113f6d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:35 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b683dca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[13caa018-722d-4da8-a4d7-0334550ed0d1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75c7603-7a5c-41c9-8e13-ea57593579c7]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51d108-293d-4b7b-9f64-54a341a0e3fe]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a107005e-737c-4bf7-85cc-91ad624db730]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[35386204-8713-476a-b08d-65fb3d3027d2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69e1f8-2955-49ef-a48f-f8caa3285d59]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260]
Nov 15 18:54:35 user nova-compute[75634]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec, portal: 172.16.0.220,3260] successful.
Nov 15 18:54:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e6d5f5-0f70-4f79-a6e8-44208773bbec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19a808-848a-41ef-98f1-01e6eb4ad301]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] <== disconnect_volume: return (362ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:54:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Deleting instance files /opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48_del
Nov 15 18:54:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Deletion of /opt/stack/data/nova/instances/6903a62f-7273-4616-9f37-a072c7e47c48_del complete
Nov 15 18:54:35 user nova-compute[75634]: INFO nova.compute.manager [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Took 1.75 seconds to destroy the instance on the hypervisor.
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] Acquiring lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] Lock "6903a62f-7273-4616-9f37-a072c7e47c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] No waiting events found dispatching network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:36 user nova-compute[75634]: WARNING nova.compute.manager [req-a58cb70f-6341-4c4c-95d9-d78c9bfe51f3 req-7e86fb25-81c6-410f-a357-8daf465822f3 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received unexpected event network-vif-plugged-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b for instance with vm_state active and task_state deleting.
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:36 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Took 1.09 seconds to deallocate network for instance.
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:36 user nova-compute[75634]: WARNING nova.compute.manager [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state stopped and task_state powering-on.
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [req-20b975eb-1b32-4d0d-bc52-e12463136960 req-7a84be3c-d980-423c-8f1f-244fc8563b22 service nova] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Received event network-vif-deleted-3b2f8a3e-2ac7-43ae-b928-f5e9a273e52b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:54:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance rebooted successfully.
Nov 15 18:54:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-799ddbf9-fe6d-4026-ac28-72d4ab8f0c51 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:37 user nova-compute[75634]: INFO nova.compute.manager [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 18:54:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: 6903a62f-7273-4616-9f37-a072c7e47c48] Deleting volume: 05e6d5f5-0f70-4f79-a6e8-44208773bbec {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:54:37 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Deleted allocations for instance 6903a62f-7273-4616-9f37-a072c7e47c48
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3c54d115-9832-4c1b-aa3d-ee0df82d5da8 tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "6903a62f-7273-4616-9f37-a072c7e47c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.550s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLbRMlFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:54:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:38 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:54:38 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429e37a-b4dc-4fe2-81a1-e076a7e80529]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:54:38 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e1055-93cb-401d-9d41-c5e15fa6a452]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac] added
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ca386-5f3b-4546-ac7e-3d876296c816]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd646c8-a2d9-440b-8f84-ed1380ee0e2a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLbRMlFU {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLbRMlFU" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f606f5b-885b-48dc-addb-faf52046661d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLbRMlFU'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f1110-4ceb-4b75-a545-f52730fb1cce]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a228e71-6950-4338-9ae9-795b65bb141e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f3f61-7736-4ad5-a867-1689b77350d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260]
Nov 15 18:54:38 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260] successful.
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c02d7-b8f0-47ba-b952-33f6f49cebaa]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb2b05-45dc-4a10-9445-753ec607a36e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:54:38 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:54:38 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e5289-cf88-431a-8587-a393dbcc4cd7]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:54:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=24.83755874633789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLbRMlFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26431646532393765', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431646532393765', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:54:39 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:54:39 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:54:39 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:54:39 user nova-compute[75634]:   <serial>1da0aef3-66be-4c5c-8c78-7e7cf74e5bac</serial>
Nov 15 18:54:39 user nova-compute[75634]: </disk>
Nov 15 18:54:39 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance b44cd307-ffbe-4ccd-996f-299ce61b60a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e703006a-80fb-438a-9bcb-3149a505a116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dba2413-c35a-4a8d-811c-0cbf75b503b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:54:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] No VIF found with MAC fa:16:3e:92:53:64, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:54:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fd4ba26d-5c36-4c5e-8c20-12fde1f2622f tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.635s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:54:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-changed-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing instance network info cache due to event network-changed-b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing network info cache for port b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updated VIF entry in instance network info cache for port b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-683f31e0-bbf4-436a-8cb9-97d24b9cea86 req-52af1c83-2afb-4cf7-b29e-a7118ed16527 service nova] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-changed-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing instance network info cache due to event network-changed-b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing network info cache for port b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updated VIF entry in instance network info cache for port b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6e333aee-bb54-4c3c-adf6-714ea29dc497 req-d1e198b0-5cb8-43bd-b513-295af526464e service nova] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:47 user nova-compute[75634]: INFO nova.compute.manager [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Rebooting instance
Nov 15 18:54:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:54:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:54:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:54:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:54:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:54:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:54:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:51 user nova-compute[75634]: DEBUG nova.compute.manager [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:51 user nova-compute[75634]: WARNING nova.compute.manager [req-8391605a-dbb8-4bfb-8683-da02b9b10f85 req-89ee7924-a937-4182-9c0e-6cb007636960 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state active and task_state reboot_started.
Nov 15 18:54:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:51 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance shutdown successfully.
Nov 15 18:54:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:53 user nova-compute[75634]: WARNING nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state active and task_state reboot_started.
Nov 15 18:54:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:53 user nova-compute[75634]: WARNING nova.compute.manager [req-b98278aa-12f9-4c39-a14e-04f626668871 req-43181271-1381-4c4f-ac57-c97abe275c5d service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state active and task_state reboot_started.
Nov 15 18:54:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:54:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance running successfully.
Nov 15 18:54:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance soft rebooted successfully.
Nov 15 18:54:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2afe27bd-54a0-450f-9053-635b56b746d1 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.557s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:54:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:54:55 user nova-compute[75634]: WARNING nova.compute.manager [req-0a4b4d73-3a1e-4eb1-8b5b-d788f88d7089 req-054367cd-5b95-458d-805b-3e5f782da220 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state active and task_state None.
Nov 15 18:54:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:11 user nova-compute[75634]: INFO nova.compute.manager [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Rescuing
Nov 15 18:55:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:55:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:55:11 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:55:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating instance_info_cache with network_info: [{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:12 user nova-compute[75634]: WARNING nova.compute.manager [req-4ea69956-acde-4edb-82fc-52f11e9e9bb7 req-574d3560-3839-44db-a0da-48753efff380 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance destroyed successfully.
Nov 15 18:55:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Attempting a stable device rescue
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:55:12 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Creating image(s)
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "c41684f6d409169542a2f3188a80ddf958d22ffa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "c41684f6d409169542a2f3188a80ddf958d22ffa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:14 user nova-compute[75634]: WARNING nova.compute.manager [req-939b6263-9d4a-45fa-bb25-130b8a43d677 req-40b3f80c-3eed-4a05-a706-46e015990e34 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG nova.virt.images [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] de91a7ca-8011-4caf-9af4-af40054696d0 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.part /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.part /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.converted" returned: 0 in 0.383s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "c41684f6d409169542a2f3188a80ddf958d22ffa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.196s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "c41684f6d409169542a2f3188a80ddf958d22ffa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "c41684f6d409169542a2f3188a80ddf958d22ffa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa,backing_fmt=raw /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa,backing_fmt=raw /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue" returned: 0 in 0.047s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "c41684f6d409169542a2f3188a80ddf958d22ffa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'migration_context' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<01dba5ab-f76c-4337-b544-342783f33418> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start _get_guest_xml network_info=[{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:8c:e4:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'de91a7ca-8011-4caf-9af4-af40054696d0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '01dba5ab-f76c-4337-b544-342783f33418', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'serial': 'b1b48291-f4e1-4c7f-9d49-6679c0f7c613'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '7b4a74af-4b7c-467c-b793-9f09511bcbc2', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<01dba5ab-f76c-4337-b544-342783f33418> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'numa_topology' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<01dba5ab-f76c-4337-b544-342783f33418> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<01dba5ab-f76c-4337-b544-342783f33418> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:55:15 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:55:15 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:55:15 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d810d-16f3-4561-8dc1-09f3281ea629]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XJRTIGxs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 18:55:15 user nova-compute[75634]: node.name = iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:55:15 user nova-compute[75634]: node.tpgt = -1
Nov 15 18:55:15 user nova-compute[75634]: node.startup = automatic
Nov 15 18:55:15 user nova-compute[75634]: node.leading_login = No
Nov 15 18:55:15 user nova-compute[75634]: iface.iscsi_ifacename = default
Nov 15 18:55:15 user nova-compute[75634]: iface.net_ifacename = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.ipaddress = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.prefix_len = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.hwaddress = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.transport_name = tcp
Nov 15 18:55:15 user nova-compute[75634]: iface.initiatorname = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.vlan_id = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.vlan_priority = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.vlan_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.iface_num = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.mtu = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.port = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.bootproto = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.subnet_mask = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.gateway = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_alt_client_id = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_dns = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_learn_iqn = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_vendor_id_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_vendor_id = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.dhcp_slp_da = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.fragmentation = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.gratuitous_arp = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.incoming_forwarding = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.tos_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.tos = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.ttl = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.delayed_ack = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.tcp_nagle = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.tcp_wsf_state = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.tcp_wsf = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.tcp_timer_scale = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.tcp_timestamp = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.redirect = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.def_task_mgmt_timeout = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.header_digest = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.data_digest = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.immediate_data = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.initial_r2t = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.data_seq_inorder = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.data_pdu_inorder = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.erl = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.max_receive_data_len = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.first_burst_len = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.max_outstanding_r2t = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.max_burst_len = 0
Nov 15 18:55:15 user nova-compute[75634]: iface.chap_auth = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.bidi_chap = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.strict_login_compliance = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.discovery_auth = <empty>
Nov 15 18:55:15 user nova-compute[75634]: iface.discovery_logout = <empty>
Nov 15 18:55:15 user nova-compute[75634]: node.discovery_address = <empty>
Nov 15 18:55:15 user nova-compute[75634]: node.discovery_port = 0
Nov 15 18:55:15 user nova-compute[75634]: node.discovery_type = static
Nov 15 18:55:15 user nova-compute[75634]: node.session.initial_cmdsn = 0
Nov 15 18:55:15 user nova-compute[75634]: node.session.initial_login_retry_max = 8
Nov 15 18:55:15 user nova-compute[75634]: node.session.xmit_thread_priority = -20
Nov 15 18:55:15 user nova-compute[75634]: node.session.cmds_max = 128
Nov 15 18:55:15 user nova-compute[75634]: node.session.queue_depth = 32
Nov 15 18:55:15 user nova-compute[75634]: node.session.nr_sessions = 1
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.authmethod = CHAP
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.username = XJRTIGxs
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.password = ***
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.username_in = <empty>
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.password_in = <empty>
Nov 15 18:55:15 user nova-compute[75634]: node.session.auth.chap_algs = MD5
Nov 15 18:55:15 user nova-compute[75634]: node.session.timeo.replacement_timeout = 120
Nov 15 18:55:15 user nova-compute[75634]: node.session.err_timeo.abort_timeout = 15
Nov 15 18:55:15 user nova-compute[75634]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 18:55:15 user nova-compute[75634]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 18:55:15 user nova-compute[75634]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.FastAbort = Yes
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.InitialR2T = No
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.ImmediateData = Yes
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.MaxConnections = 1
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 18:55:15 user nova-compute[75634]: node.session.iscsi.ERL = 0
Nov 15 18:55:15 user nova-compute[75634]: node.session.scan = manual
Nov 15 18:55:15 user nova-compute[75634]: node.session.reopen_max = 0
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].address = 172.16.0.220
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].port = 3260
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].startup = manual
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].tcp.window_size = 524288
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].tcp.type_of_service = 0
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].timeo.logout_timeout = 15
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].timeo.login_timeout = 15
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].timeo.auth_timeout = 45
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.DataDigest = None
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.IFMarker = No
Nov 15 18:55:15 user nova-compute[75634]: node.conn[0].iscsi.OFMarker = No
Nov 15 18:55:15 user nova-compute[75634]: # END RECORD
Nov 15 18:55:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[13444625-1f17-47b0-b4f3-df9767ae0913]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdfae82-9b10-4939-9bb7-ba6782f536e5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJRTIGxs {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJRTIGxs" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba914d-ccb8-4a61-b1e5-15f8c50c7de5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJRTIGxs'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a893d-6002-424e-9479-e3f800caeb7b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3032cc-40b9-4254-8706-a3db346198e0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:15 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] HCTL ('35', '0', '0', 0) found on session 51 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ae51f-2204-47af-8577-47c18de0128e]: (4, ('0 0 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Searching for a device in session 51 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23632613130613430', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632613130613430', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348165560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348165560',id=41,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:53:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-a72ygr20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:38Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=01dba5ab-f76c-4337-b544-342783f33418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:8c:e4:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "vif_mac": "fa:16:3e:8c:e4:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'pci_devices' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.objects.base [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Object Instance<01dba5ab-f76c-4337-b544-342783f33418> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:55:15 user nova-compute[75634]:   <uuid>01dba5ab-f76c-4337-b544-342783f33418</uuid>
Nov 15 18:55:15 user nova-compute[75634]:   <name>instance-00000029</name>
Nov 15 18:55:15 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:55:15 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:55:15 user nova-compute[75634]:   <metadata>
Nov 15 18:55:15 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:55:15 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-348165560</nova:name>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:55:15</nova:creationTime>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:55:15 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:55:15 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:owner>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:user uuid="000d54e8a82d48b58f554ae085a4dab0">tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member</nova:user>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:project uuid="c17eb80780ad4231889417dab82ea2cf">tempest-ServerBootFromVolumeStableRescueTest-1503063619</nova:project>
Nov 15 18:55:15 user nova-compute[75634]:       </nova:owner>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:55:15 user nova-compute[75634]:       <nova:ports>
Nov 15 18:55:15 user nova-compute[75634]:         <nova:port uuid="bb827498-b525-4a37-b08b-c7a26522cd93">
Nov 15 18:55:15 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 18:55:15 user nova-compute[75634]:         </nova:port>
Nov 15 18:55:15 user nova-compute[75634]:       </nova:ports>
Nov 15 18:55:15 user nova-compute[75634]:     </nova:instance>
Nov 15 18:55:15 user nova-compute[75634]:   </metadata>
Nov 15 18:55:15 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:55:15 user nova-compute[75634]:     <system>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="serial">01dba5ab-f76c-4337-b544-342783f33418</entry>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="uuid">01dba5ab-f76c-4337-b544-342783f33418</entry>
Nov 15 18:55:15 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:55:15 user nova-compute[75634]:     </system>
Nov 15 18:55:15 user nova-compute[75634]:   </sysinfo>
Nov 15 18:55:15 user nova-compute[75634]:   <os>
Nov 15 18:55:15 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:55:15 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:55:15 user nova-compute[75634]:   </os>
Nov 15 18:55:15 user nova-compute[75634]:   <features>
Nov 15 18:55:15 user nova-compute[75634]:     <acpi/>
Nov 15 18:55:15 user nova-compute[75634]:     <apic/>
Nov 15 18:55:15 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:55:15 user nova-compute[75634]:   </features>
Nov 15 18:55:15 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:55:15 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:55:15 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:55:15 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:55:15 user nova-compute[75634]:   </clock>
Nov 15 18:55:15 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:55:15 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:55:15 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:55:15 user nova-compute[75634]:   </cpu>
Nov 15 18:55:15 user nova-compute[75634]:   <devices>
Nov 15 18:55:15 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:55:15 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:55:15 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:55:15 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:55:15 user nova-compute[75634]:       <serial>b1b48291-f4e1-4c7f-9d49-6679c0f7c613</serial>
Nov 15 18:55:15 user nova-compute[75634]:     </disk>
Nov 15 18:55:15 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:55:15 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:55:15 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue"/>
Nov 15 18:55:15 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:55:15 user nova-compute[75634]:       <boot order="1"/>
Nov 15 18:55:15 user nova-compute[75634]:     </disk>
Nov 15 18:55:15 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:55:15 user nova-compute[75634]:       <mac address="fa:16:3e:8c:e4:dd"/>
Nov 15 18:55:15 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:55:15 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:55:15 user nova-compute[75634]:       <target dev="tapbb827498-b5"/>
Nov 15 18:55:15 user nova-compute[75634]:     </interface>
Nov 15 18:55:15 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:55:15 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/console.log" append="off"/>
Nov 15 18:55:15 user nova-compute[75634]:     </serial>
Nov 15 18:55:15 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:55:15 user nova-compute[75634]:     <video>
Nov 15 18:55:15 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:55:15 user nova-compute[75634]:     </video>
Nov 15 18:55:15 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:55:15 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:55:15 user nova-compute[75634]:     </rng>
Nov 15 18:55:15 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:55:15 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:55:15 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:55:15 user nova-compute[75634]:     </memballoon>
Nov 15 18:55:15 user nova-compute[75634]:   </devices>
Nov 15 18:55:15 user nova-compute[75634]: </domain>
Nov 15 18:55:15 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:55:15 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance destroyed successfully.
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] No VIF found with MAC fa:16:3e:8c:e4:dd, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:55:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:17 user nova-compute[75634]: WARNING nova.compute.manager [req-37c0c6dd-a2b0-444a-9bf9-0997ebbb4d9f req-1756e446-8f65-429e-976f-f601933fc326 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:19 user nova-compute[75634]: WARNING nova.compute.manager [req-578d00b9-d845-41a7-9892-f2c7c4b0a035 req-7604d10e-bd59-4788-8989-ae89f6c379b2 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:19 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bfd41f1c-5d76-47ea-8458-02f1209c3c60 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:55:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing instance network info cache due to event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'flavor' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:26 user nova-compute[75634]: INFO nova.compute.manager [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Terminating instance
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updated VIF entry in instance network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG nova.network.neutron [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2259250e-e82a-4613-9fed-0f9930b70344 req-04f5b300-82f5-46c2-8eb6-19ceec7a7960 service nova] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:26 user nova-compute[75634]: INFO nova.compute.manager [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Attaching volume d7198ea8-adf9-4fb0-9408-a6693b42efe9 to /dev/vdb
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-unplugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] No waiting events found dispatching network-vif-unplugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-7402f467-1f9a-4d25-b580-ca6744742cd3 req-6ca76b88-337e-4baa-b23c-836a90ae9823 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-unplugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.utils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ceb3f-aa60-4d60-9e42-d832ac93ff8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8e0fd-1a9f-49bb-b1e1-b7c4a8273bde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c30a2b-ffe4-4c01-b229-f92f14571e39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[852a07d8-e478-48f6-9d0d-c922afc5bec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:55:27 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa6943-b499-4a31-a79d-d5c67940b8e4]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_brick.utils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating existing volume attachment record: d5f0001e-0f74-4f64-8d9e-6ebc229189ab {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:55:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Instance destroyed successfully.
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lazy-loading 'resources' on Instance uuid b44cd307-ffbe-4ccd-996f-299ce61b60a6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1228526431',display_name='tempest-ServerActionsTestOtherA-server-1228526431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1228526431',id=4,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMJoRvrO2CauHfx97Y+EP1LMx86OBRoUyClR59J+I7svqlaQwWPbtqB4rkrErqK0UQciypB4mAOPOg0k+7ZBFe4VAHyogEMyi9+56JJn6W5dvfLzFjedeLccNhCXDKfjA==',key_name='tempest-keypair-1826395130',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:36:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb5adcf609a4fd7a67d3574243cc920',ramdisk_id='',reservation_id='r-4nq50hc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1839012723',owner_user_name='tempest-ServerActionsTestOtherA-1839012723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ebb5c4075034b1482d50a9ff5dd990b',uuid=b44cd307-ffbe-4ccd-996f-299ce61b60a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converting VIF {"id": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "address": "fa:16:3e:42:1d:0c", "network": {"id": "991a1e52-e875-48b3-9ce9-ae921f1f1043", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1648297771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb5adcf609a4fd7a67d3574243cc920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c5d0ab-3a", "ovs_interfaceid": "32c5d0ab-3ab1-4cee-90d7-22298c5e753d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG os_vif [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c5d0ab-3a, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19b99d9c-97df-4310-bb47-a7dd139ff156) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:27 user nova-compute[75634]: INFO os_vif [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=32c5d0ab-3ab1-4cee-90d7-22298c5e753d,network=Network(991a1e52-e875-48b3-9ce9-ae921f1f1043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c5d0ab-3a')
Nov 15 18:55:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Deleting instance files /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6_del
Nov 15 18:55:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Deletion of /opt/stack/data/nova/instances/b44cd307-ffbe-4ccd-996f-299ce61b60a6_del complete
Nov 15 18:55:27 user nova-compute[75634]: INFO nova.compute.manager [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 18:55:27 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:55:27 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:28 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Took 0.62 seconds to deallocate network for instance.
Nov 15 18:55:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-67ab46a1-c3ef-4fd4-91b3-535a1b0b484e req-848c99b5-b609-4e9f-9a94-49d78e4ac226 service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-deleted-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:55:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:28 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Deleted allocations for instance b44cd307-ffbe-4ccd-996f-299ce61b60a6
Nov 15 18:55:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60b5b277-d9f2-4ddf-beca-4536e4da00cb tempest-ServerActionsTestOtherA-1839012723 tempest-ServerActionsTestOtherA-1839012723-project-member] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] Acquiring lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] Lock "b44cd307-ffbe-4ccd-996f-299ce61b60a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] No waiting events found dispatching network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:29 user nova-compute[75634]: WARNING nova.compute.manager [req-e1968ac0-555d-4fa0-997a-a78e2473d0e7 req-9e4b9866-d9c0-472e-896c-e68e4e69259b service nova] [instance: b44cd307-ffbe-4ccd-996f-299ce61b60a6] Received unexpected event network-vif-plugged-32c5d0ab-3ab1-4cee-90d7-22298c5e753d for instance with vm_state deleted and task_state None.
Nov 15 18:55:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecFoAnTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:55:32 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:55:32 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:55:32 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[381ea579-a57d-4db3-928c-b12faef55a82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:55:32 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f613387-016a-404a-9583-9c197cbbd198]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9] added
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.066s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9d2e6-99d8-4ed7-82d2-9889c211d73f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc33989c-7d4b-491e-978c-2df9bc651176]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecFoAnTy {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecFoAnTy" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c65855-6e09-4c07-a6db-fa64e8f81497]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ecFoAnTy'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62376d-6af3-4380-b2dc-6b70c5972394]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334b18c-7f8a-4478-a61e-8e474bb08c1e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e31ce1-4ee4-427a-908f-1ef49d97e77b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260]
Nov 15 18:55:32 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260] successful.
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1484915f-d24d-4602-b7be-d40e44342c4e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8007ff-6e9d-4d01-9410-3cd59ada07bb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:32 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:55:32 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] HCTL ('38', '-', '-', 0) found on session 55 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed46387-4b61-4313-9f2a-7c3cc9f00628]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching for a device in session 55 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:55:32 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecFoAnTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23330616235626431', 'path': '/dev/sdg'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330616235626431', 'path': '/dev/sdg'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'flavor' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 18:55:33 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:55:33 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:55:33 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:55:33 user nova-compute[75634]:   <serial>d7198ea8-adf9-4fb0-9408-a6693b42efe9</serial>
Nov 15 18:55:33 user nova-compute[75634]: </disk>
Nov 15 18:55:33 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:28:b4:7b, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-60c34d71-bf21-473d-87bf-5193e3cf6279 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.339s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:34 user nova-compute[75634]: INFO nova.compute.manager [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Rescuing
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:35 user nova-compute[75634]: WARNING nova.compute.manager [req-a55e67cc-3dcc-4aa7-b890-8f8c1e33ac34 req-7d3d30c3-5ab9-42ff-ab6d-1b224997d334 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance destroyed successfully.
Nov 15 18:55:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Attempting rescue
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 18:55:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Creating image(s)
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'trusted_certs' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue" returned: 0 in 0.047s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'migration_context' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<538aaff2-3904-4638-a624-36c9fee87a2d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start _get_guest_xml network_info=[{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:28:b4:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<538aaff2-3904-4638-a624-36c9fee87a2d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'numa_topology' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<538aaff2-3904-4638-a624-36c9fee87a2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'vcpu_model' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<538aaff2-3904-4638-a624-36c9fee87a2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-279912819',display_name='tempest-ServerRescueNegativeTestJSON-server-279912819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-279912819',id=42,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKe6FRSwbyKr2hLUmb5k1aqFzWqHw3DorcgFPnimfcB12lUevYE7nsW5gi9GbXPJLE4rOEGbYKFOBAWecQwe+6E+Y728lkjEOJXDrB3GHvrRY3mwii7/u+M4XX4NXEKhg==',key_name='tempest-keypair-425341621',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-98227wgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395915213ac442edbdd3d80e03367744',uuid=538aaff2-3904-4638-a624-36c9fee87a2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:28:b4:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "vif_mac": "fa:16:3e:28:b4:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'pci_devices' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Object Instance<538aaff2-3904-4638-a624-36c9fee87a2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:55:36 user nova-compute[75634]:   <uuid>538aaff2-3904-4638-a624-36c9fee87a2d</uuid>
Nov 15 18:55:36 user nova-compute[75634]:   <name>instance-0000002a</name>
Nov 15 18:55:36 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:55:36 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:55:36 user nova-compute[75634]:   <metadata>
Nov 15 18:55:36 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:55:36 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-279912819</nova:name>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:55:36</nova:creationTime>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:55:36 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:55:36 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:owner>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:user uuid="395915213ac442edbdd3d80e03367744">tempest-ServerRescueNegativeTestJSON-1650146848-project-member</nova:user>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:project uuid="0dfe1f0276a74611b6cf863fa909aa61">tempest-ServerRescueNegativeTestJSON-1650146848</nova:project>
Nov 15 18:55:36 user nova-compute[75634]:       </nova:owner>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:55:36 user nova-compute[75634]:       <nova:ports>
Nov 15 18:55:36 user nova-compute[75634]:         <nova:port uuid="01cc67d7-ff33-4c0b-a21f-ebb0890d3686">
Nov 15 18:55:36 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:55:36 user nova-compute[75634]:         </nova:port>
Nov 15 18:55:36 user nova-compute[75634]:       </nova:ports>
Nov 15 18:55:36 user nova-compute[75634]:     </nova:instance>
Nov 15 18:55:36 user nova-compute[75634]:   </metadata>
Nov 15 18:55:36 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:55:36 user nova-compute[75634]:     <system>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="serial">538aaff2-3904-4638-a624-36c9fee87a2d</entry>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="uuid">538aaff2-3904-4638-a624-36c9fee87a2d</entry>
Nov 15 18:55:36 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:55:36 user nova-compute[75634]:     </system>
Nov 15 18:55:36 user nova-compute[75634]:   </sysinfo>
Nov 15 18:55:36 user nova-compute[75634]:   <os>
Nov 15 18:55:36 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:55:36 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:55:36 user nova-compute[75634]:   </os>
Nov 15 18:55:36 user nova-compute[75634]:   <features>
Nov 15 18:55:36 user nova-compute[75634]:     <acpi/>
Nov 15 18:55:36 user nova-compute[75634]:     <apic/>
Nov 15 18:55:36 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:55:36 user nova-compute[75634]:   </features>
Nov 15 18:55:36 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:55:36 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:55:36 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:55:36 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:55:36 user nova-compute[75634]:   </clock>
Nov 15 18:55:36 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:55:36 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:55:36 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:55:36 user nova-compute[75634]:   </cpu>
Nov 15 18:55:36 user nova-compute[75634]:   <devices>
Nov 15 18:55:36 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:55:36 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:55:36 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue"/>
Nov 15 18:55:36 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:55:36 user nova-compute[75634]:     </disk>
Nov 15 18:55:36 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:55:36 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:55:36 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk"/>
Nov 15 18:55:36 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 18:55:36 user nova-compute[75634]:     </disk>
Nov 15 18:55:36 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:55:36 user nova-compute[75634]:       <mac address="fa:16:3e:28:b4:7b"/>
Nov 15 18:55:36 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:55:36 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:55:36 user nova-compute[75634]:       <target dev="tap01cc67d7-ff"/>
Nov 15 18:55:36 user nova-compute[75634]:     </interface>
Nov 15 18:55:36 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:55:36 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/console.log" append="off"/>
Nov 15 18:55:36 user nova-compute[75634]:     </serial>
Nov 15 18:55:36 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:55:36 user nova-compute[75634]:     <video>
Nov 15 18:55:36 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:55:36 user nova-compute[75634]:     </video>
Nov 15 18:55:36 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:55:36 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:55:36 user nova-compute[75634]:     </rng>
Nov 15 18:55:36 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:55:36 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:55:36 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:55:36 user nova-compute[75634]:     </memballoon>
Nov 15 18:55:36 user nova-compute[75634]:   </devices>
Nov 15 18:55:36 user nova-compute[75634]: </domain>
Nov 15 18:55:36 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:55:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance destroyed successfully.
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] No VIF found with MAC fa:16:3e:28:b4:7b, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:37 user nova-compute[75634]: WARNING nova.compute.manager [req-10ce34e8-42ef-418b-b5a7-8122d912a1ed req-b99d1eab-74cf-482a-84f4-a167f922f34b service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:40 user nova-compute[75634]: WARNING nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:40 user nova-compute[75634]: WARNING nova.compute.manager [req-5d286590-3dde-4658-815d-b29bc3f0fe4a req-8cc01a47-3a03-495a-8cb3-3c7d4077cb7d service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state active and task_state rescuing.
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-94a632bd-6503-4dc4-ad09-25851563fc22 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:55:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=24.756080627441406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e703006a-80fb-438a-9bcb-3149a505a116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dba2413-c35a-4a8d-811c-0cbf75b503b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:55:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:55:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:55:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:55:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:55:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updating instance_info_cache with network_info: [{"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-d324a863-5fde-4342-815f-da9a158d5df7" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:55:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:55:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-changed-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG nova.compute.manager [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Refreshing instance network info cache due to event network-changed-468e47db-6145-43d7-a361-44dea5792a3a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] Acquiring lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] Acquired lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Refreshing network info cache for port 468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updated VIF entry in instance network info cache for port 468e47db-6145-43d7-a361-44dea5792a3a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:55:54 user nova-compute[75634]: DEBUG nova.network.neutron [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updating instance_info_cache with network_info: [{"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-685789da-8418-4fca-90b2-92079d921dc2 req-2a648c97-1945-466e-a8ed-dd12f74070f4 service nova] Releasing lock "refresh_cache-8dba2413-c35a-4a8d-811c-0cbf75b503b1" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:56 user nova-compute[75634]: INFO nova.compute.manager [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Terminating instance
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-unplugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] No waiting events found dispatching network-vif-unplugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-1509117a-d249-4f25-ab7d-e927e1b9db5b req-bb22d53e-9549-4616-b882-cb1c58ab2828 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-unplugged-468e47db-6145-43d7-a361-44dea5792a3a for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Instance destroyed successfully.
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.objects.instance [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid 8dba2413-c35a-4a8d-811c-0cbf75b503b1 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1672375050',display_name='tempest-TestVolumeBootPattern-server-1672375050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1672375050',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-qzhm872s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:54:13Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=8dba2413-c35a-4a8d-811c-0cbf75b503b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "468e47db-6145-43d7-a361-44dea5792a3a", "address": "fa:16:3e:e5:32:14", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468e47db-61", "ovs_interfaceid": "468e47db-6145-43d7-a361-44dea5792a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG os_vif [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap468e47db-61, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be9fb143-251b-449c-a545-cff69fe06814) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:55:56 user nova-compute[75634]: INFO os_vif [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:32:14,bridge_name='br-int',has_traffic_filtering=True,id=468e47db-6145-43d7-a361-44dea5792a3a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468e47db-61')
Nov 15 18:55:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:55:57 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d70293-d1e4-44fb-91fd-8bfcc0689dbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:55:57 user nova-compute[75634]: No targets found.
Nov 15 18:55:57 user nova-compute[75634]: iSNS:
Nov 15 18:55:57 user nova-compute[75634]: No targets found.
Nov 15 18:55:57 user nova-compute[75634]: STATIC:
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:55:57 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:55:57 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:55:57 user nova-compute[75634]: FIRMWARE:
Nov 15 18:55:57 user nova-compute[75634]: No targets found.
Nov 15 18:55:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:55:57 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:55:57 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c16630-5d4e-4200-ab4e-f267d11f2f48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff107b-ed2f-40d3-a60d-b8d60db96214]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:55:57 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:55:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4433d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a267c9-0579-430f-888a-057f18913aaf]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef75f1-0a37-4d70-b304-7f41a5e25b3d]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de2380-1424-4ebd-a1c8-04f88fc0cd4e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e144dd-2f75-4a33-acce-e12ea8ad5aae]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82364e5-5ee7-404c-9420-ed86e9983ea4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35fa50-9be3-444b-85bd-a34636d245b0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]
Nov 15 18:55:57 user nova-compute[75634]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.
Nov 15 18:55:57 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57e214d-44b7-48b1-b9c6-e181dafa3b94]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (368ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:55:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Deleting instance files /opt/stack/data/nova/instances/8dba2413-c35a-4a8d-811c-0cbf75b503b1_del
Nov 15 18:55:57 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Deletion of /opt/stack/data/nova/instances/8dba2413-c35a-4a8d-811c-0cbf75b503b1_del complete
Nov 15 18:55:57 user nova-compute[75634]: INFO nova.compute.manager [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 18:55:57 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:55:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:55:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] Acquiring lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:55:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] No waiting events found dispatching network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:55:58 user nova-compute[75634]: WARNING nova.compute.manager [req-9bd9c33f-2c97-4c20-bcb1-bbd6ef0eada9 req-f43b2fb5-3f35-4717-b5b2-32b69cfd0db5 service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received unexpected event network-vif-plugged-468e47db-6145-43d7-a361-44dea5792a3a for instance with vm_state active and task_state deleting.
Nov 15 18:55:58 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:55:58 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Took 1.30 seconds to deallocate network for instance.
Nov 15 18:55:59 user nova-compute[75634]: INFO nova.compute.manager [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Took 0.89 seconds to detach 1 volumes for instance.
Nov 15 18:55:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:55:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:55:59 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:55:59 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:56:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:00 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance 8dba2413-c35a-4a8d-811c-0cbf75b503b1
Nov 15 18:56:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-6d6eb91c-b847-4a1f-881c-74060e9e0d08 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "8dba2413-c35a-4a8d-811c-0cbf75b503b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.044s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:00 user nova-compute[75634]: DEBUG nova.compute.manager [req-fdc2e814-3f58-4206-9cae-d357c8170252 req-39e33638-f6ec-4460-bcee-c5a4b8fed74a service nova] [instance: 8dba2413-c35a-4a8d-811c-0cbf75b503b1] Received event network-vif-deleted-468e47db-6145-43d7-a361-44dea5792a3a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:56:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:21 user nova-compute[75634]: INFO nova.compute.manager [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Detaching volume 22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:56:21 user nova-compute[75634]: INFO nova.virt.block_device [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Attempting to driver detach volume 22b7f92c-945d-4e23-be2b-59c467cd540b from mountpoint /dev/vdb
Nov 15 18:56:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Attempting to detach device vdb from instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:56:21 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:56:21 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:56:21 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:56:21 user nova-compute[75634]:   <serial>22b7f92c-945d-4e23-be2b-59c467cd540b</serial>
Nov 15 18:56:21 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:56:21 user nova-compute[75634]: </disk>
Nov 15 18:56:21 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:56:21 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdb from instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 from the persistent domain config.
Nov 15 18:56:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:56:21 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:56:21 user nova-compute[75634]:   <source dev="/dev/sde"/>
Nov 15 18:56:21 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:56:21 user nova-compute[75634]:   <serial>22b7f92c-945d-4e23-be2b-59c467cd540b</serial>
Nov 15 18:56:21 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 18:56:21 user nova-compute[75634]: </disk>
Nov 15 18:56:21 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:56:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:56:31 user nova-compute[75634]: INFO nova.compute.claims [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Claim successful on node user
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:56:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.policy [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70bb03f0f7e14a35990cb0378b225f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ecd8bd04f64bec81495973abc55d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:56:31 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Creating image(s)
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:31 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk 1073741824" returned: 0 in 0.050s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Successfully created port: 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Cannot resize image /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Ensure instance console log exists: /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:32 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Successfully updated port: 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing instance network info cache due to event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance network_info: |[{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start _get_guest_xml network_info=[{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:56:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:33 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-285015549',display_name='tempest-ServerStableDeviceRescueTest-server-285015549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-285015549',id=44,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZX9edWOakXvTWec1sJJQeU3ZnjwvYevllHIUyQIxaVB0yft859vc0IgXJtsX53aLJUn8u5Gd3WfUxNpLBYsBpVv7ljGGT42x1GsEsBqn/jyIqChF03q4brUFZNRUkbA==',key_name='tempest-keypair-458089163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3ecd8bd04f64bec81495973abc55d4c',ramdisk_id='',reservation_id='r-wmukpqpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1481719976',owner_user_name='tempest-ServerStableDeviceRescueTest-1481719976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bb03f0f7e14a35990cb0378b225f66',uuid=ae61a358-95d3-4d6f-a127-fb2bacd88afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converting VIF {"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'pci_devices' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:56:33 user nova-compute[75634]:   <uuid>ae61a358-95d3-4d6f-a127-fb2bacd88afa</uuid>
Nov 15 18:56:33 user nova-compute[75634]:   <name>instance-0000002c</name>
Nov 15 18:56:33 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:56:33 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:56:33 user nova-compute[75634]:   <metadata>
Nov 15 18:56:33 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:56:33 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-285015549</nova:name>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:56:33</nova:creationTime>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:56:33 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:56:33 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:owner>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:user uuid="70bb03f0f7e14a35990cb0378b225f66">tempest-ServerStableDeviceRescueTest-1481719976-project-member</nova:user>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:project uuid="c3ecd8bd04f64bec81495973abc55d4c">tempest-ServerStableDeviceRescueTest-1481719976</nova:project>
Nov 15 18:56:33 user nova-compute[75634]:       </nova:owner>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:56:33 user nova-compute[75634]:       <nova:ports>
Nov 15 18:56:33 user nova-compute[75634]:         <nova:port uuid="4cf8faf0-cb34-443e-b98c-0ea6048aeef7">
Nov 15 18:56:33 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 18:56:33 user nova-compute[75634]:         </nova:port>
Nov 15 18:56:33 user nova-compute[75634]:       </nova:ports>
Nov 15 18:56:33 user nova-compute[75634]:     </nova:instance>
Nov 15 18:56:33 user nova-compute[75634]:   </metadata>
Nov 15 18:56:33 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:56:33 user nova-compute[75634]:     <system>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="serial">ae61a358-95d3-4d6f-a127-fb2bacd88afa</entry>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="uuid">ae61a358-95d3-4d6f-a127-fb2bacd88afa</entry>
Nov 15 18:56:33 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:56:33 user nova-compute[75634]:     </system>
Nov 15 18:56:33 user nova-compute[75634]:   </sysinfo>
Nov 15 18:56:33 user nova-compute[75634]:   <os>
Nov 15 18:56:33 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:56:33 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:56:33 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:56:33 user nova-compute[75634]:   </os>
Nov 15 18:56:33 user nova-compute[75634]:   <features>
Nov 15 18:56:33 user nova-compute[75634]:     <acpi/>
Nov 15 18:56:33 user nova-compute[75634]:     <apic/>
Nov 15 18:56:33 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:56:33 user nova-compute[75634]:   </features>
Nov 15 18:56:33 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:56:33 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:56:33 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:56:33 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:56:33 user nova-compute[75634]:   </clock>
Nov 15 18:56:33 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:56:33 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:56:33 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:56:33 user nova-compute[75634]:   </cpu>
Nov 15 18:56:33 user nova-compute[75634]:   <devices>
Nov 15 18:56:33 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:56:33 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:56:33 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk"/>
Nov 15 18:56:33 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:56:33 user nova-compute[75634]:     </disk>
Nov 15 18:56:33 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:56:33 user nova-compute[75634]:       <mac address="fa:16:3e:9f:53:8f"/>
Nov 15 18:56:33 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:56:33 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:56:33 user nova-compute[75634]:       <target dev="tap4cf8faf0-cb"/>
Nov 15 18:56:33 user nova-compute[75634]:     </interface>
Nov 15 18:56:33 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:56:33 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/console.log" append="off"/>
Nov 15 18:56:33 user nova-compute[75634]:     </serial>
Nov 15 18:56:33 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:56:33 user nova-compute[75634]:     <video>
Nov 15 18:56:33 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:56:33 user nova-compute[75634]:     </video>
Nov 15 18:56:33 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:56:33 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:56:33 user nova-compute[75634]:     </rng>
Nov 15 18:56:33 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:56:33 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:56:33 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:56:33 user nova-compute[75634]:     </memballoon>
Nov 15 18:56:33 user nova-compute[75634]:   </devices>
Nov 15 18:56:33 user nova-compute[75634]: </domain>
Nov 15 18:56:33 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-285015549',display_name='tempest-ServerStableDeviceRescueTest-server-285015549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-285015549',id=44,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZX9edWOakXvTWec1sJJQeU3ZnjwvYevllHIUyQIxaVB0yft859vc0IgXJtsX53aLJUn8u5Gd3WfUxNpLBYsBpVv7ljGGT42x1GsEsBqn/jyIqChF03q4brUFZNRUkbA==',key_name='tempest-keypair-458089163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3ecd8bd04f64bec81495973abc55d4c',ramdisk_id='',reservation_id='r-wmukpqpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1481719976',owner_user_name='tempest-ServerStableDeviceRescueTest-1481719976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bb03f0f7e14a35990cb0378b225f66',uuid=ae61a358-95d3-4d6f-a127-fb2bacd88afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converting VIF {"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG os_vif [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd67412a-9e19-583a-8c63-1471bba4ea0d', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cf8faf0-cb, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cf8faf0-cb, col_values=(('qos', UUID('5d6fa378-00d8-40eb-aea2-50aaa8d55e0d')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cf8faf0-cb, col_values=(('external_ids', {'iface-id': '4cf8faf0-cb34-443e-b98c-0ea6048aeef7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:53:8f', 'vm-uuid': 'ae61a358-95d3-4d6f-a127-fb2bacd88afa'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:33 user nova-compute[75634]: INFO os_vif [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb')
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No VIF found with MAC fa:16:3e:9f:53:8f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated VIF entry in instance network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c01dbfc-aefc-4cd3-8c72-fe36c93ed8a4 req-ba2613c6-5ac1-4d9c-bc4d-55ca99f7f79a service nova] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:34 user nova-compute[75634]: WARNING nova.compute.manager [req-00fed473-afb4-495a-a6a1-a77efead50c5 req-f7c82a2c-350a-48da-b727-e85d7020ef31 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state building and task_state spawning.
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:56:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:56:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance spawned successfully.
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:37 user nova-compute[75634]: WARNING nova.compute.manager [req-915575a1-c53e-4ed3-8a99-8fcb1a2e9ea2 req-fbaf64eb-57a3-4267-94d0-6bc71b083f51 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state building and task_state spawning.
Nov 15 18:56:37 user nova-compute[75634]: INFO nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 15 18:56:37 user nova-compute[75634]: DEBUG nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:56:37 user nova-compute[75634]: INFO nova.compute.manager [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Took 6.06 seconds to build instance.
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-af555e7a-c06d-4a22-a20e-f988967248a6 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.160s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-changed-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing instance network info cache due to event network-changed-b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing network info cache for port b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=24.750904083251953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-changed-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing instance network info cache due to event network-changed-b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:56:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] Acquiring lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance e703006a-80fb-438a-9bcb-3149a505a116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:40 user nova-compute[75634]: INFO nova.compute.manager [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Detaching volume 1da0aef3-66be-4c5c-8c78-7e7cf74e5bac
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updated VIF entry in instance network info cache for port b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:40 user nova-compute[75634]: INFO nova.virt.block_device [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Attempting to driver detach volume 1da0aef3-66be-4c5c-8c78-7e7cf74e5bac from mountpoint /dev/vdb
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b65d533a-b9af-4a59-a905-81b9fe86c7a0 req-63554b45-0ad7-4c74-a184-6941f430966e service nova] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] Acquired lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Refreshing network info cache for port b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Attempting to detach device vdb from instance e703006a-80fb-438a-9bcb-3149a505a116 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:56:40 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:56:40 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:56:40 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:56:40 user nova-compute[75634]:   <serial>1da0aef3-66be-4c5c-8c78-7e7cf74e5bac</serial>
Nov 15 18:56:40 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:56:40 user nova-compute[75634]: </disk>
Nov 15 18:56:40 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:56:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully detached device vdb from instance e703006a-80fb-438a-9bcb-3149a505a116 from the persistent domain config.
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e703006a-80fb-438a-9bcb-3149a505a116 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:56:40 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:56:40 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 18:56:40 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:56:40 user nova-compute[75634]:   <serial>1da0aef3-66be-4c5c-8c78-7e7cf74e5bac</serial>
Nov 15 18:56:40 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:56:40 user nova-compute[75634]: </disk>
Nov 15 18:56:40 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updated VIF entry in instance network info cache for port b7504859-c358-4e92-abe1-23f616a3049f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [{"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f32e984a-5cec-4b4f-9ae8-e912c3046dce req-b2615061-4c7a-4849-8444-e59cdf41f99e service nova] Releasing lock "refresh_cache-e703006a-80fb-438a-9bcb-3149a505a116" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:41 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 is timed out.
Nov 15 18:56:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdb from instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 from the live domain config.
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYjwbIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:56:41 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f82c382-8e6b-4d61-9a82-1939a729ac0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:56:41 user nova-compute[75634]: No targets found.
Nov 15 18:56:41 user nova-compute[75634]: iSNS:
Nov 15 18:56:41 user nova-compute[75634]: No targets found.
Nov 15 18:56:41 user nova-compute[75634]: STATIC:
Nov 15 18:56:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac
Nov 15 18:56:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:56:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:56:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:56:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:56:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:56:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b
Nov 15 18:56:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:56:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:56:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:56:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:56:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:56:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:56:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:56:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:56:41 user nova-compute[75634]: FIRMWARE:
Nov 15 18:56:41 user nova-compute[75634]: No targets found.
Nov 15 18:56:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:56:41 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:56:41 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd41c9-f1e0-4fb6-a1b9-1491118c2dc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d711a-5321-4831-a1ae-4f2eefc4c1e3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:41 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4435b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [{"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ce074-b9ee-42b4-95f8-87579b97e205]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85fe007-871d-45a1-8fd3-3f8ad0264f96]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34616cb-e0ad-4de1-a771-e18a0879cda2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa360da-23c1-4347-9d36-7b1a28768f26]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:56:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc78fc-f31f-4c07-8b31-0f4db185aa84]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f2d4b9-80b8-4c1c-96d6-df1a0c0e2e6c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260]
Nov 15 18:56:42 user nova-compute[75634]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b, portal: 172.16.0.220,3260] successful.
Nov 15 18:56:42 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7f92c-945d-4e23-be2b-59c467cd540b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741027b-dc7c-4b37-a913-294f537dd758]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== disconnect_volume: return (345ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:56:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e2290a-e308-4a5f-b8e2-0b7d19d7a045 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75634) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 18:56:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:44 user nova-compute[75634]: WARNING nova.compute.manager [req-dbc17cc9-d40b-4e8b-942c-e001a262fba7 req-fda9ae8f-8a89-4c7b-8f94-936ecab02ab7 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state active and task_state powering-off.
Nov 15 18:56:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance destroyed successfully.
Nov 15 18:56:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:56:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-fcfe12d2-0dfe-4b82-bc4b-be52bda2cd4d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.825s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:46 user nova-compute[75634]: WARNING nova.compute.manager [req-552b39ee-e42c-4cdc-b97b-da016c588601 req-8cebbc96-854c-4e6f-813b-6d67702fad6f service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state stopped and task_state None.
Nov 15 18:56:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:56:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:56:47 user nova-compute[75634]: INFO nova.compute.claims [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Claim successful on node user
Nov 15 18:56:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:56:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.policy [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:56:48 user nova-compute[75634]: INFO nova.virt.block_device [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Booting with volume 1dca3e22-a600-43ab-b92f-48c0e821d092 at /dev/vda
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.utils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1deb4-5363-4687-b22a-06a03b97f0dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf258732-9c6c-4e56-a559-aabc16dcd461]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a9c736-7293-41a9-ab5c-201275e1fdb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46edee-d51f-4743-9db9-800020dae6b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:56:48 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:56:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e6309-9e64-4879-a068-dd27bc04dc39]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG os_brick.utils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:56:48 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating existing volume attachment record: 7bfdf018-9c91-42d8-bc0b-5ef84d54d45b {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Successfully created port: c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Successfully updated port: c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-changed-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing instance network info cache due to event network-changed-c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] Acquiring lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:56:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG nova.network.neutron [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating instance_info_cache with network_info: [{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Instance network_info: |[{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] Acquired lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing network info cache for port c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updated VIF entry in instance network info cache for port c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG nova.network.neutron [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating instance_info_cache with network_info: [{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:56:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bd1d536a-6d63-4036-9cee-242c4ed7b881 req-5e74453c-3e4d-4f8d-9461-def11014c9c5 service nova] Releasing lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:56:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:56:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Creating image(s)
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Ensure instance console log exists: /opt/stack/data/nova/instances/db6e015d-0328-4524-8f25-79ef5f54ef40/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Start _get_guest_xml network_info=[{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db6e015d-0328-4524-8f25-79ef5f54ef40', 'attached_at': '', 'detached_at': '', 'volume_id': '1dca3e22-a600-43ab-b92f-48c0e821d092', 'serial': '1dca3e22-a600-43ab-b92f-48c0e821d092'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '7bfdf018-9c91-42d8-bc0b-5ef84d54d45b', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:56:53 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:53 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:56:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:56:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:56:53 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d060b2-b13d-460a-a61f-5619bf7a2482]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:56:53 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56e30a5-c432-4dc0-baab-985fa9c75af5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092] added
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[29598d1c-1a6e-4b66-a7dc-5bfe90b0083c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1078ca75-703a-46aa-8e90-b44b29e5e562]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQNPtenv {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQNPtenv" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[66614809-fdf2-4201-bdf1-5ee15eee72c0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQNPtenv'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b317c7af-7806-488a-8023-f0260150ac83]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c038c1-1962-4359-89c0-81557df2fcea]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ab2b9-4191-4ca2-9d53-96a2a3202beb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]
Nov 15 18:56:53 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d64bfa-2991-4bca-b2c3-ef315ace38d3]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a97c1f-9d70-4751-9e33-d405bc27e369]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:56:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86030deb-5cdd-40ba-8b2d-904fdfad0717]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:56:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23166336334663033', 'path': '/dev/sde'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166336334663033', 'path': '/dev/sde'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414785433',display_name='tempest-TestVolumeBootPattern-server-1414785433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414785433',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-jkuhdhp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:56:48Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=db6e015d-0328-4524-8f25-79ef5f54ef40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.objects.instance [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid db6e015d-0328-4524-8f25-79ef5f54ef40 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:56:54 user nova-compute[75634]:   <uuid>db6e015d-0328-4524-8f25-79ef5f54ef40</uuid>
Nov 15 18:56:54 user nova-compute[75634]:   <name>instance-0000002d</name>
Nov 15 18:56:54 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:56:54 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:56:54 user nova-compute[75634]:   <metadata>
Nov 15 18:56:54 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:56:54 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:56:54 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-server-1414785433</nova:name>
Nov 15 18:56:54 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:56:53</nova:creationTime>
Nov 15 18:56:54 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:56:54 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:56:54 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:56:54 user nova-compute[75634]:       <nova:owner>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:56:54 user nova-compute[75634]:       </nova:owner>
Nov 15 18:56:54 user nova-compute[75634]:       <nova:ports>
Nov 15 18:56:54 user nova-compute[75634]:         <nova:port uuid="c69eede0-9686-476b-9f6b-80c77112028a">
Nov 15 18:56:54 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 18:56:54 user nova-compute[75634]:         </nova:port>
Nov 15 18:56:54 user nova-compute[75634]:       </nova:ports>
Nov 15 18:56:54 user nova-compute[75634]:     </nova:instance>
Nov 15 18:56:54 user nova-compute[75634]:   </metadata>
Nov 15 18:56:54 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:56:54 user nova-compute[75634]:     <system>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="serial">db6e015d-0328-4524-8f25-79ef5f54ef40</entry>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="uuid">db6e015d-0328-4524-8f25-79ef5f54ef40</entry>
Nov 15 18:56:54 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:56:54 user nova-compute[75634]:     </system>
Nov 15 18:56:54 user nova-compute[75634]:   </sysinfo>
Nov 15 18:56:54 user nova-compute[75634]:   <os>
Nov 15 18:56:54 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:56:54 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:56:54 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:56:54 user nova-compute[75634]:   </os>
Nov 15 18:56:54 user nova-compute[75634]:   <features>
Nov 15 18:56:54 user nova-compute[75634]:     <acpi/>
Nov 15 18:56:54 user nova-compute[75634]:     <apic/>
Nov 15 18:56:54 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:56:54 user nova-compute[75634]:   </features>
Nov 15 18:56:54 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:56:54 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:56:54 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:56:54 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:56:54 user nova-compute[75634]:   </clock>
Nov 15 18:56:54 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:56:54 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:56:54 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:56:54 user nova-compute[75634]:   </cpu>
Nov 15 18:56:54 user nova-compute[75634]:   <devices>
Nov 15 18:56:54 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:56:54 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:56:54 user nova-compute[75634]:       <source dev="/dev/sde"/>
Nov 15 18:56:54 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:56:54 user nova-compute[75634]:       <serial>1dca3e22-a600-43ab-b92f-48c0e821d092</serial>
Nov 15 18:56:54 user nova-compute[75634]:     </disk>
Nov 15 18:56:54 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:56:54 user nova-compute[75634]:       <mac address="fa:16:3e:0d:f1:c5"/>
Nov 15 18:56:54 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:56:54 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:56:54 user nova-compute[75634]:       <target dev="tapc69eede0-96"/>
Nov 15 18:56:54 user nova-compute[75634]:     </interface>
Nov 15 18:56:54 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:56:54 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/db6e015d-0328-4524-8f25-79ef5f54ef40/console.log" append="off"/>
Nov 15 18:56:54 user nova-compute[75634]:     </serial>
Nov 15 18:56:54 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:56:54 user nova-compute[75634]:     <video>
Nov 15 18:56:54 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:56:54 user nova-compute[75634]:     </video>
Nov 15 18:56:54 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:56:54 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:56:54 user nova-compute[75634]:     </rng>
Nov 15 18:56:54 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:56:54 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:56:54 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:56:54 user nova-compute[75634]:     </memballoon>
Nov 15 18:56:54 user nova-compute[75634]:   </devices>
Nov 15 18:56:54 user nova-compute[75634]: </domain>
Nov 15 18:56:54 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414785433',display_name='tempest-TestVolumeBootPattern-server-1414785433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414785433',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-jkuhdhp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:56:48Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=db6e015d-0328-4524-8f25-79ef5f54ef40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG os_vif [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bf954a5-a3c2-55b2-a784-96cf0b6f4bcc', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69eede0-96, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc69eede0-96, col_values=(('qos', UUID('e03b0fe8-7eec-42fe-b4b6-1ff1da57038b')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc69eede0-96, col_values=(('external_ids', {'iface-id': 'c69eede0-9686-476b-9f6b-80c77112028a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f1:c5', 'vm-uuid': 'db6e015d-0328-4524-8f25-79ef5f54ef40'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:56:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:54 user nova-compute[75634]: INFO os_vif [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96')
Nov 15 18:56:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:56:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:0d:f1:c5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] No waiting events found dispatching network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:56 user nova-compute[75634]: WARNING nova.compute.manager [req-1c455ee7-876a-4108-afef-3f921b89cbe8 req-5449d382-6a1c-4f27-acb0-787c36b14b36 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received unexpected event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a for instance with vm_state building and task_state spawning.
Nov 15 18:56:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] No waiting events found dispatching network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:56:58 user nova-compute[75634]: WARNING nova.compute.manager [req-4636cb21-9f9a-499f-ae1e-b4028905a13f req-a94478cb-572f-4267-9953-0b11d22576e7 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received unexpected event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a for instance with vm_state building and task_state spawning.
Nov 15 18:56:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:56:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:56:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Instance spawned successfully.
Nov 15 18:56:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:56:59 user nova-compute[75634]: INFO nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 15 18:56:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:56:59 user nova-compute[75634]: INFO nova.compute.manager [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Took 11.44 seconds to build instance.
Nov 15 18:56:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-ba83d216-184f-4f7f-9eb7-aaaaeeb78346 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.537s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:56:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:00 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e703006a-80fb-438a-9bcb-3149a505a116 is timed out.
Nov 15 18:57:00 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully detached device vdb from instance e703006a-80fb-438a-9bcb-3149a505a116 from the live domain config.
Nov 15 18:57:00 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLbRMlFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:57:00 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a9b70-9352-4798-818b-8becdd4525a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:57:00 user nova-compute[75634]: No targets found.
Nov 15 18:57:00 user nova-compute[75634]: iSNS:
Nov 15 18:57:00 user nova-compute[75634]: No targets found.
Nov 15 18:57:00 user nova-compute[75634]: STATIC:
Nov 15 18:57:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac
Nov 15 18:57:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:57:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:57:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:57:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:57:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:57:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:57:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:57:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:57:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:57:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:57:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:57:00 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:57:00 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:57:00 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:57:00 user nova-compute[75634]: FIRMWARE:
Nov 15 18:57:00 user nova-compute[75634]: No targets found.
Nov 15 18:57:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:57:00 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:57:00 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8d321-5ce4-4c88-a4a1-59ae2718b1b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba245398-4b76-4fb0-b06e-cfae0fd60a20]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:57:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44314a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ef30d1-b556-422a-baf3-c9a5f6cadfbd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa328a4-2152-4d27-93b1-8c32f3093c52]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f8920-4674-4c9e-88db-8e3031a5ff8e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[48988f3f-818b-468d-b099-66e75f3eb018]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[629767fe-0917-4550-bab2-7b73f1b52028]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:57:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c9266-2c08-4739-a080-e3e85cfa851b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260]
Nov 15 18:57:01 user nova-compute[75634]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac, portal: 172.16.0.220,3260] successful.
Nov 15 18:57:01 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da0aef3-66be-4c5c-8c78-7e7cf74e5bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fdc4b-f18d-4444-91bc-24b9d0be6ad9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] <== disconnect_volume: return (314ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:57:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG nova.objects.instance [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'flavor' on Instance uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-476ce8fa-e939-4a96-98b9-b0399621787a tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.905s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:02 user nova-compute[75634]: INFO nova.compute.manager [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Unrescuing
Nov 15 18:57:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquired lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG nova.network.neutron [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating instance_info_cache with network_info: [{"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Releasing lock "refresh_cache-01dba5ab-f76c-4337-b544-342783f33418" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'flavor' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG nova.compute.manager [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:03 user nova-compute[75634]: WARNING nova.compute.manager [req-b752e780-c5ce-4eac-a46b-1f1cdc8d9441 req-93d3dd0c-a23d-4b43-8637-eacf3855e528 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:03 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance destroyed successfully.
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:05 user nova-compute[75634]: WARNING nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:05 user nova-compute[75634]: WARNING nova.compute.manager [req-4310ec43-75a9-4cea-a923-bd432f88c819 req-fb1ced18-5d28-4b41-bece-4b7cdcfa0e1c service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:06 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b46b7ba7-a396-4a5e-ae45-496e0b34e3b1 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:57:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:07 user nova-compute[75634]: WARNING nova.compute.manager [req-6c1dc3e8-ed98-46f5-89f5-582f8ac5166a req-0986bd88-0fe5-4972-a17b-af22e713d93e service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state None.
Nov 15 18:57:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:26 user nova-compute[75634]: INFO nova.compute.manager [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Unrescuing
Nov 15 18:57:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:57:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'flavor' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:27 user nova-compute[75634]: WARNING nova.compute.manager [req-d441bded-c8d1-4a32-abd3-56bd683c47ab req-c9de2ecb-f98a-4752-8ead-5f43b3d33cd8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance destroyed successfully.
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:29 user nova-compute[75634]: WARNING nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:29 user nova-compute[75634]: WARNING nova.compute.manager [req-3610e368-db0d-4505-86da-8660cd3f94cd req-7986c568-2be5-4872-ac4a-67bc588049d6 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state rescued and task_state unrescuing.
Nov 15 18:57:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-243ffc95-a3ff-443b-912e-2087583fa839 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:31 user nova-compute[75634]: WARNING nova.compute.manager [req-018a7be0-3529-4033-9b03-226769f02f3d req-9398f4f1-b91a-4777-b6d0-38d7199a9825 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state active and task_state None.
Nov 15 18:57:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:32 user nova-compute[75634]: INFO nova.compute.manager [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Terminating instance
Nov 15 18:57:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Instance destroyed successfully.
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.objects.instance [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lazy-loading 'resources' on Instance uuid e703006a-80fb-438a-9bcb-3149a505a116 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-unplugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Acquiring lock "e703006a-80fb-438a-9bcb-3149a505a116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] Lock "e703006a-80fb-438a-9bcb-3149a505a116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] No waiting events found dispatching network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:57:33 user nova-compute[75634]: WARNING nova.compute.manager [req-77ba8414-e5e2-45bc-aa3c-31b9fd7d89d8 req-8157dbad-4e73-441e-918a-97a22d81b2f8 service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received unexpected event network-vif-plugged-b7504859-c358-4e92-abe1-23f616a3049f for instance with vm_state active and task_state deleting.
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285570684',display_name='tempest-TestMinimumBasicScenario-server-285570684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285570684',id=40,image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA6erBWORk9is5A20OxR3sH2uEqngO6OE9qLuz4twB3AXcs3ChN1jOkVs2GtpiIzu9PhQTwf8qItmzrULCgmGObDC8+pslwxWCrF6gC+JDZqriPbmaCJDN2vd0ybP2CMg==',key_name='tempest-TestMinimumBasicScenario-318052602',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='247be554293e4d36a923272a63270742',ramdisk_id='',reservation_id='r-685emy6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7cd3eb93-8b79-4da9-b6a2-adc5320602a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-547369327',owner_user_name='tempest-TestMinimumBasicScenario-547369327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:54:55Z,user_data=None,user_id='cfa5c40718134a13a514c8a165b42ab3',uuid=e703006a-80fb-438a-9bcb-3149a505a116,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converting VIF {"id": "b7504859-c358-4e92-abe1-23f616a3049f", "address": "fa:16:3e:92:53:64", "network": {"id": "017426be-bf39-484c-a8d2-05ca9769c958", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1841706053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "247be554293e4d36a923272a63270742", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7504859-c3", "ovs_interfaceid": "b7504859-c358-4e92-abe1-23f616a3049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG os_vif [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7504859-c3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd1aa36b-44f4-4ea4-b46a-4f867f9413e6) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:33 user nova-compute[75634]: INFO os_vif [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:53:64,bridge_name='br-int',has_traffic_filtering=True,id=b7504859-c358-4e92-abe1-23f616a3049f,network=Network(017426be-bf39-484c-a8d2-05ca9769c958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7504859-c3')
Nov 15 18:57:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Deleting instance files /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116_del
Nov 15 18:57:33 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Deletion of /opt/stack/data/nova/instances/e703006a-80fb-438a-9bcb-3149a505a116_del complete
Nov 15 18:57:33 user nova-compute[75634]: INFO nova.compute.manager [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 18:57:33 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:57:33 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:57:34 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Took 0.54 seconds to deallocate network for instance.
Nov 15 18:57:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-cf41cdcf-7f82-4ab3-86c9-57f172e8c443 req-d66d6927-5e26-41e0-bef6-c4ff2bc040ba service nova] [instance: e703006a-80fb-438a-9bcb-3149a505a116] Received event network-vif-deleted-b7504859-c358-4e92-abe1-23f616a3049f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:57:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:34 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Deleted allocations for instance e703006a-80fb-438a-9bcb-3149a505a116
Nov 15 18:57:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-313396c6-5299-4ffa-8b50-0183dfc32b22 tempest-TestMinimumBasicScenario-547369327 tempest-TestMinimumBasicScenario-547369327-project-member] Lock "e703006a-80fb-438a-9bcb-3149a505a116" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:57:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:57:38 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:57:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=24.740985870361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:57:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db6e015d-0328-4524-8f25-79ef5f54ef40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:57:40 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [{"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-0ecd19a3-6712-411c-94fe-bdc95fc2b28c" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:57:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:57:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 18:57:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 18:57:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:57:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:58:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing instance network info cache due to event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated VIF entry in instance network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9e8dca9-5507-4379-950d-4f78a1ffebd7 req-fa40fa70-ff68-4f72-a62e-0b94f1e42bb8 service nova] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG nova.compute.manager [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:58:24 user nova-compute[75634]: INFO nova.compute.manager [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] instance snapshotting
Nov 15 18:58:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Beginning live snapshot process
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json -f qcow2 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:24 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea.delta 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea.delta 1073741824" returned: 0 in 0.068s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 18:58:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:58:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75634) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 18:58:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 18:58:26 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 18:58:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea.delta /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea.delta /opt/stack/data/nova/instances/snapshots/tmprzua46_c/f9b8f714808444df8d54d99724d8a2ea" returned: 0 in 0.781s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Snapshot extracted, beginning image upload
Nov 15 18:58:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Snapshot image upload complete
Nov 15 18:58:30 user nova-compute[75634]: INFO nova.compute.manager [None req-45fc3195-1465-49b6-ac6c-c8b8df1318fe tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Took 5.86 seconds to snapshot the instance on the hypervisor.
Nov 15 18:58:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquired lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'info_cache' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:34 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Releasing lock "refresh_cache-1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance destroyed successfully.
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'resources' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG os_vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcfb27d8-ed, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=439b53ae-99ed-4015-bf1d-60447939ed3a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:35 user nova-compute[75634]: INFO os_vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start _get_guest_xml network_info=[{"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:35 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:35 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:58:35 user nova-compute[75634]:   <uuid>1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</uuid>
Nov 15 18:58:35 user nova-compute[75634]:   <name>instance-00000026</name>
Nov 15 18:58:35 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:58:35 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:58:35 user nova-compute[75634]:   <metadata>
Nov 15 18:58:35 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:58:35 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeTestJSON-server-643925418</nova:name>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:58:35</nova:creationTime>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:58:35 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:58:35 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:owner>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:user uuid="89755cafe30b4013b0642283a83bab00">tempest-AttachVolumeTestJSON-915928723-project-member</nova:user>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:project uuid="812d9a6afc424b4eb1e6d50d3035531a">tempest-AttachVolumeTestJSON-915928723</nova:project>
Nov 15 18:58:35 user nova-compute[75634]:       </nova:owner>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 18:58:35 user nova-compute[75634]:       <nova:ports>
Nov 15 18:58:35 user nova-compute[75634]:         <nova:port uuid="dcfb27d8-ed70-4d06-a254-0dd85a62cde1">
Nov 15 18:58:35 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 18:58:35 user nova-compute[75634]:         </nova:port>
Nov 15 18:58:35 user nova-compute[75634]:       </nova:ports>
Nov 15 18:58:35 user nova-compute[75634]:     </nova:instance>
Nov 15 18:58:35 user nova-compute[75634]:   </metadata>
Nov 15 18:58:35 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:58:35 user nova-compute[75634]:     <system>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="serial">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="uuid">1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6</entry>
Nov 15 18:58:35 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:58:35 user nova-compute[75634]:     </system>
Nov 15 18:58:35 user nova-compute[75634]:   </sysinfo>
Nov 15 18:58:35 user nova-compute[75634]:   <os>
Nov 15 18:58:35 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:58:35 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:58:35 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:58:35 user nova-compute[75634]:   </os>
Nov 15 18:58:35 user nova-compute[75634]:   <features>
Nov 15 18:58:35 user nova-compute[75634]:     <acpi/>
Nov 15 18:58:35 user nova-compute[75634]:     <apic/>
Nov 15 18:58:35 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:58:35 user nova-compute[75634]:   </features>
Nov 15 18:58:35 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:58:35 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:58:35 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:58:35 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:58:35 user nova-compute[75634]:   </clock>
Nov 15 18:58:35 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:58:35 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:58:35 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:58:35 user nova-compute[75634]:   </cpu>
Nov 15 18:58:35 user nova-compute[75634]:   <devices>
Nov 15 18:58:35 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 18:58:35 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 18:58:35 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk"/>
Nov 15 18:58:35 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:58:35 user nova-compute[75634]:     </disk>
Nov 15 18:58:35 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:58:35 user nova-compute[75634]:       <mac address="fa:16:3e:d2:0b:cc"/>
Nov 15 18:58:35 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:58:35 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:58:35 user nova-compute[75634]:       <target dev="tapdcfb27d8-ed"/>
Nov 15 18:58:35 user nova-compute[75634]:     </interface>
Nov 15 18:58:35 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:58:35 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/console.log" append="off"/>
Nov 15 18:58:35 user nova-compute[75634]:     </serial>
Nov 15 18:58:35 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:58:35 user nova-compute[75634]:     <video>
Nov 15 18:58:35 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:58:35 user nova-compute[75634]:     </video>
Nov 15 18:58:35 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:58:35 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:58:35 user nova-compute[75634]:     </rng>
Nov 15 18:58:35 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:58:35 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:58:35 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:58:35 user nova-compute[75634]:     </memballoon>
Nov 15 18:58:35 user nova-compute[75634]:   </devices>
Nov 15 18:58:35 user nova-compute[75634]: </domain>
Nov 15 18:58:35 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:58:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Cannot resize image /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'migration_context' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.objects.base [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Object Instance<1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG os_vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bb5d7f1-8f54-5416-9165-4fc3c71e251e', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcfb27d8-ed, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcfb27d8-ed, col_values=(('qos', UUID('e892f282-360a-461d-8ef3-e793cd6dfc7c')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcfb27d8-ed, col_values=(('external_ids', {'iface-id': 'dcfb27d8-ed70-4d06-a254-0dd85a62cde1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0b:cc', 'vm-uuid': '1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:36 user nova-compute[75634]: INFO os_vif [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 18:58:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:37 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:38 user nova-compute[75634]: WARNING nova.compute.manager [req-8882327c-c9d5-4275-8c53-1623c5a10d6d req-b88336da-9d1d-451e-9f7a-6f367107101a service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state stopped and task_state powering-on.
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-changed-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing instance network info cache due to event network-changed-c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] Acquiring lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] Acquired lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing network info cache for port c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updated VIF entry in instance network info cache for port c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating instance_info_cache with network_info: [{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e9370548-6b19-4942-850d-4dce0efbf361 req-13eeb8b6-26af-4e37-9fdf-48d1419c4125 service nova] Releasing lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:58:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance rebooted successfully.
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.compute.manager [None req-37fe614c-567e-4814-873f-dc534b467ed6 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:40 user nova-compute[75634]: WARNING nova.compute.manager [req-cf2023a8-3a6f-4596-b1d9-36cd48a1d984 req-a22c402f-e4b1-4844-a12e-6c5117761671 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state active and task_state None.
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7836MB free_disk=24.73011016845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 01dba5ab-f76c-4337-b544-342783f33418 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db6e015d-0328-4524-8f25-79ef5f54ef40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:58:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:58:47 user nova-compute[75634]: INFO nova.compute.claims [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Claim successful on node user
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:58:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:58:47 user nova-compute[75634]: INFO nova.virt.block_device [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Booting with volume 6e14e8b3-d62e-47a1-9590-12e6999a061e at /dev/vda
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.policy [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4cce3e6acd4e279a8e1746f980987b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfcc977f8a14a7c8d13d1eed1061b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6068d1e-547e-41e7-8e2d-683de2ac8cf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[395691fc-fb5b-4542-9c41-2a0f004cff65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a01fc0-bbe0-4634-9bd7-3ca03d8e641c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7d3e00-c06f-4ee8-aa72-c4fba1498a11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:58:47 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:58:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c9bb9-464f-4e4f-8038-0919f16eb1ca]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG os_brick.utils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:58:47 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating existing volume attachment record: 6486de62-cfc9-4d02-a6a0-07fa95d52f5f {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:58:48 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Successfully created port: d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Successfully updated port: d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquired lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.compute.manager [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing instance network info cache due to event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] Acquiring lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating instance_info_cache with network_info: [{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Releasing lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Instance network_info: |[{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] Acquired lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updated VIF entry in instance network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG nova.network.neutron [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating instance_info_cache with network_info: [{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-50f265fc-6b10-4da2-b2bf-7ed5e4bda1e3 req-3591d0d1-9fe4-4312-b2c8-22bafaee22b0 service nova] Releasing lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:58:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Creating image(s)
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Ensure instance console log exists: /opt/stack/data/nova/instances/0a2942f6-8bcd-4256-bd67-dab571bd689b/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Start _get_guest_xml network_info=[{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoFuKjdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a2942f6-8bcd-4256-bd67-dab571bd689b', 'attached_at': '', 'detached_at': '', 'volume_id': '6e14e8b3-d62e-47a1-9590-12e6999a061e', 'serial': '6e14e8b3-d62e-47a1-9590-12e6999a061e'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': '6486de62-cfc9-4d02-a6a0-07fa95d52f5f', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:58:53 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:53 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoFuKjdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:58:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:58:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:58:53 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd63710-4e49-4441-81b5-826cf51b50ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:58:53 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 18:58:53 user nova-compute[75634]: INFO nova.compute.claims [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Claim successful on node user
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18cc92a-f56a-4c57-96c7-039b82cf0531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e] added
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[05795a68-7f4d-4bd1-b99a-dab7be7eeaa8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0459c382-7e7b-4775-9a9d-5e75222526bc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoFuKjdw {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:53 user nova-compute[75634]: INFO nova.compute.manager [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Terminating instance
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoFuKjdw" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60ad40-b156-4df6-9a73-2ec187938ad5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EoFuKjdw'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f7264-781e-4b65-84d1-b611d01e1bd4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b73897-bbb4-4cf2-97f7-ef54ecaa2919]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8f757d-075a-41f5-aa96-c6bd2f628221]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260]
Nov 15 18:58:53 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260] successful.
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[22949e47-9d0d-4a01-a528-363a3f4de249]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22198e2-8d38-49f2-b40f-47161cf6321e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:53 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba0117-fec0-4b2a-b232-90506950537a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoFuKjdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [req-e7f2846c-dcac-4818-a226-b376920f57a4 req-4865ea43-9e8b-4440-b659-493e098d761a service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-unplugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 18:58:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.policy [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ffd656a0cc4f579c03d651715433d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a864fca2b14cb7b073b3f8574ea9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 18:58:54 user nova-compute[75634]: INFO nova.virt.block_device [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Booting with volume 65bcff69-6349-4196-9987-6dce55b5e708 at /dev/vda
Nov 15 18:58:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Instance destroyed successfully.
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.objects.instance [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid 01dba5ab-f76c-4337-b544-342783f33418 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348165560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348165560',id=41,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-a72ygr20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:57:07Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=01dba5ab-f76c-4337-b544-342783f33418,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "bb827498-b525-4a37-b08b-c7a26522cd93", "address": "fa:16:3e:8c:e4:dd", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb827498-b5", "ovs_interfaceid": "bb827498-b525-4a37-b08b-c7a26522cd93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_vif [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb827498-b5, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25ac84b5-b8ea-45e6-8872-e46ad3b60152) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:54 user nova-compute[75634]: INFO os_vif [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e4:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb827498-b525-4a37-b08b-c7a26522cd93,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb827498-b5')
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.utils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJRTIGxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:58:54 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df96c1-5afa-4030-acbc-d899f681749b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[576270c5-8fb1-41a6-99f7-bfdcda9d7c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd2575-b382-4846-9205-207521e53fa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640ddcb-7d38-4202-90c6-c4dc18117c38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 18:58:54 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dda521-bb25-4bd8-8d88-a5b2db7f9ed5]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.utils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating existing volume attachment record: c965ac92-9aab-417a-b758-b64784f90a06 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23162666136613937', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162666136613937', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.446s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[551bed07-b4d8-4f4a-bb3f-4fcbbc8b6c00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:58:54 user nova-compute[75634]: No targets found.
Nov 15 18:58:54 user nova-compute[75634]: iSNS:
Nov 15 18:58:54 user nova-compute[75634]: No targets found.
Nov 15 18:58:54 user nova-compute[75634]: STATIC:
Nov 15 18:58:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613
Nov 15 18:58:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:58:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:58:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e
Nov 15 18:58:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:58:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:58:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:58:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:58:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:58:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:58:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:58:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:58:54 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:58:54 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:58:54 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:58:54 user nova-compute[75634]: FIRMWARE:
Nov 15 18:58:54 user nova-compute[75634]: No targets found.
Nov 15 18:58:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:58:54 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:58:54 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-233073705',display_name='tempest-TestVolumeBootPattern-server-233073705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-233073705',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-2k6kw2nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:58:48Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=0a2942f6-8bcd-4256-bd67-dab571bd689b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.objects.instance [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a2942f6-8bcd-4256-bd67-dab571bd689b {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[635337f2-40a6-4975-86ec-fb2cfd204e59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:58:54 user nova-compute[75634]:   <uuid>0a2942f6-8bcd-4256-bd67-dab571bd689b</uuid>
Nov 15 18:58:54 user nova-compute[75634]:   <name>instance-0000002e</name>
Nov 15 18:58:54 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:58:54 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:58:54 user nova-compute[75634]:   <metadata>
Nov 15 18:58:54 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:58:54 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:58:54 user nova-compute[75634]:       <nova:name>tempest-TestVolumeBootPattern-server-233073705</nova:name>
Nov 15 18:58:54 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:58:53</nova:creationTime>
Nov 15 18:58:54 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:58:54 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:58:54 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:58:54 user nova-compute[75634]:       <nova:owner>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:user uuid="2e4cce3e6acd4e279a8e1746f980987b">tempest-TestVolumeBootPattern-34940949-project-member</nova:user>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:project uuid="3bfcc977f8a14a7c8d13d1eed1061b0f">tempest-TestVolumeBootPattern-34940949</nova:project>
Nov 15 18:58:54 user nova-compute[75634]:       </nova:owner>
Nov 15 18:58:54 user nova-compute[75634]:       <nova:ports>
Nov 15 18:58:54 user nova-compute[75634]:         <nova:port uuid="d9a66162-d3fa-464b-8a32-1f9ab4463b9b">
Nov 15 18:58:54 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 18:58:54 user nova-compute[75634]:         </nova:port>
Nov 15 18:58:54 user nova-compute[75634]:       </nova:ports>
Nov 15 18:58:54 user nova-compute[75634]:     </nova:instance>
Nov 15 18:58:54 user nova-compute[75634]:   </metadata>
Nov 15 18:58:54 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:58:54 user nova-compute[75634]:     <system>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="serial">0a2942f6-8bcd-4256-bd67-dab571bd689b</entry>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="uuid">0a2942f6-8bcd-4256-bd67-dab571bd689b</entry>
Nov 15 18:58:54 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:58:54 user nova-compute[75634]:     </system>
Nov 15 18:58:54 user nova-compute[75634]:   </sysinfo>
Nov 15 18:58:54 user nova-compute[75634]:   <os>
Nov 15 18:58:54 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:58:54 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:58:54 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:58:54 user nova-compute[75634]:   </os>
Nov 15 18:58:54 user nova-compute[75634]:   <features>
Nov 15 18:58:54 user nova-compute[75634]:     <acpi/>
Nov 15 18:58:54 user nova-compute[75634]:     <apic/>
Nov 15 18:58:54 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:58:54 user nova-compute[75634]:   </features>
Nov 15 18:58:54 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:58:54 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:58:54 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:58:54 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:58:54 user nova-compute[75634]:   </clock>
Nov 15 18:58:54 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:58:54 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:58:54 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:58:54 user nova-compute[75634]:   </cpu>
Nov 15 18:58:54 user nova-compute[75634]:   <devices>
Nov 15 18:58:54 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:58:54 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:58:54 user nova-compute[75634]:       <source dev="/dev/sdc"/>
Nov 15 18:58:54 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:58:54 user nova-compute[75634]:       <serial>6e14e8b3-d62e-47a1-9590-12e6999a061e</serial>
Nov 15 18:58:54 user nova-compute[75634]:     </disk>
Nov 15 18:58:54 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:58:54 user nova-compute[75634]:       <mac address="fa:16:3e:be:29:fc"/>
Nov 15 18:58:54 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:58:54 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:58:54 user nova-compute[75634]:       <target dev="tapd9a66162-d3"/>
Nov 15 18:58:54 user nova-compute[75634]:     </interface>
Nov 15 18:58:54 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:58:54 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/0a2942f6-8bcd-4256-bd67-dab571bd689b/console.log" append="off"/>
Nov 15 18:58:54 user nova-compute[75634]:     </serial>
Nov 15 18:58:54 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:58:54 user nova-compute[75634]:     <video>
Nov 15 18:58:54 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:58:54 user nova-compute[75634]:     </video>
Nov 15 18:58:54 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:58:54 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:58:54 user nova-compute[75634]:     </rng>
Nov 15 18:58:54 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:58:54 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:58:54 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:58:54 user nova-compute[75634]:     </memballoon>
Nov 15 18:58:54 user nova-compute[75634]:   </devices>
Nov 15 18:58:54 user nova-compute[75634]: </domain>
Nov 15 18:58:54 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-233073705',display_name='tempest-TestVolumeBootPattern-server-233073705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-233073705',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-2k6kw2nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:58:48Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=0a2942f6-8bcd-4256-bd67-dab571bd689b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_vif [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5816123-1c87-5731-b495-a9b83d145dd9', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea179b-86ed-4ca4-817d-c6d274769910]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:54 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44316830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a66162-d3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9a66162-d3, col_values=(('qos', UUID('c0b16dda-6c06-48a1-9c3f-f1d3e4a5fcda')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9a66162-d3, col_values=(('external_ids', {'iface-id': 'd9a66162-d3fa-464b-8a32-1f9ab4463b9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:29:fc', 'vm-uuid': '0a2942f6-8bcd-4256-bd67-dab571bd689b'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Successfully created port: b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af6188-4aee-419e-9f19-c438ea215e6e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: INFO os_vif [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3')
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80809ec-02d1-49fe-af0b-085991be5ab7]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a556df8-41fa-43f0-a516-9537cddc16d2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] No VIF found with MAC fa:16:3e:be:29:fc, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb0d9d1-4002-48a4-a358-51cb7da1eb93]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db9db5-5190-4870-89d6-4cab8d661004]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eb4106-d9c3-4eed-9b93-ba52ca963a37]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260]
Nov 15 18:58:54 user nova-compute[75634]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613, portal: 172.16.0.220,3260] successful.
Nov 15 18:58:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b48291-f4e1-4c7f-9d49-6679c0f7c613 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db8543-4bf0-4b57-a2de-738ecfcdecd6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== disconnect_volume: return (840ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:58:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Deleting instance files /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418_del
Nov 15 18:58:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Deletion of /opt/stack/data/nova/instances/01dba5ab-f76c-4337-b544-342783f33418_del complete
Nov 15 18:58:55 user nova-compute[75634]: INFO nova.compute.manager [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Successfully updated port: b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-changed-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing instance network info cache due to event network-changed-b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] Acquiring lock "01dba5ab-f76c-4337-b544-342783f33418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] Lock "01dba5ab-f76c-4337-b544-342783f33418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] No waiting events found dispatching network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:55 user nova-compute[75634]: WARNING nova.compute.manager [req-93db0750-f943-4ef4-b7b6-c0788932b9b8 req-70110863-ea5b-4961-80bf-8fe1a112bdc9 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received unexpected event network-vif-plugged-bb827498-b525-4a37-b08b-c7a26522cd93 for instance with vm_state active and task_state deleting.
Nov 15 18:58:55 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Took 0.64 seconds to deallocate network for instance.
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance network_info: |[{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:58:55 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing network info cache for port b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updated VIF entry in instance network info cache for port b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG nova.network.neutron [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c401328-6df7-4e6d-9884-732772bcbe9d req-8d53d2c8-d398-4a72-ae69-4ddd0d6db6d1 service nova] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:56 user nova-compute[75634]: WARNING nova.compute.manager [req-7aa07a4a-e6f5-4afa-999e-7453d6ae9755 req-f14845f6-5159-4e46-ac34-53fb8ae3af78 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state building and task_state spawning.
Nov 15 18:58:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:56 user nova-compute[75634]: INFO nova.compute.manager [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Took 0.95 seconds to detach 1 volumes for instance.
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:57 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:58:57 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:58:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:57 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Deleted allocations for instance 01dba5ab-f76c-4337-b544-342783f33418
Nov 15 18:58:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-01fb111e-d02d-4e66-8284-05f2dc4977b2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "01dba5ab-f76c-4337-b544-342783f33418" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.936s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-da56bc91-2b18-46b7-93a9-9636d994251a req-c5cc1ae3-71c9-492c-81c7-70ef98ba7c17 service nova] [instance: 01dba5ab-f76c-4337-b544-342783f33418] Received event network-vif-deleted-bb827498-b525-4a37-b08b-c7a26522cd93 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:58:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Instance spawned successfully.
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:58:58 user nova-compute[75634]: WARNING nova.compute.manager [req-d6512901-e984-4738-bc5c-68469618135c req-80aaeaba-a6fa-4f37-ae21-7a271840e564 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state building and task_state spawning.
Nov 15 18:58:58 user nova-compute[75634]: INFO nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 15 18:58:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:58:58 user nova-compute[75634]: INFO nova.compute.manager [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Took 11.59 seconds to build instance.
Nov 15 18:58:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e7bd1296-a278-4860-a2b6-011c9404de6d tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.688s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 18:58:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Creating image(s)
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Ensure instance console log exists: /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start _get_guest_xml network_info=[{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2ab1727-c3ab-4aad-801f-ce02290fc9dd', 'attached_at': '', 'detached_at': '', 'volume_id': '65bcff69-6349-4196-9987-6dce55b5e708', 'serial': '65bcff69-6349-4196-9987-6dce55b5e708'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': 'c965ac92-9aab-417a-b758-b64784f90a06', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 18:58:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:59 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:58:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:58:59 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:58:59 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219bcf6-179c-4c81-b20b-6cf2798088b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 18:58:59 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed66a69-be36-4649-9fe1-a5981b0f1861]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708] added
Nov 15 18:58:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[12632f8e-80bf-40eb-a56a-4af408cb17d8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24190d2-84fc-45e0-9aa2-56f36d08fa46]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcEHupPj {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcEHupPj" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9f76c-6439-479f-b74d-2dc13bf1be83]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcEHupPj'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c84e62-3f08-4bde-ae4b-a417cfc80501]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75abb6b-6725-4921-8711-609f05faa21b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:58:59 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:58:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc34dbf3-59e1-4255-b1ce-ad4a366c008a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]
Nov 15 18:58:59 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.
Nov 15 18:58:59 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f179010a-3cf1-4d36-b14a-374dcbaad1b8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:58:59 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.102s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5675ff-bcb3-427b-ad96-a6cedac98f38]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:59:00 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 18:59:00 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40f8cb-9220-42b2-b60b-287d7fb48363]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 18:59:00 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23131646565636634', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131646565636634', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF07aZw0gcQjxvDbxvWlrt1WG+o2A2KaYtKUkHChzTsIPcmaxSCBPAIGMyetWzOgKbVLfWnZSsG9gYi11dH9zt6mprU2yfb/XESkkRPSKQHfH3N/mwYqVQ7nd+XEwvjhVA==',key_name='tempest-TestShelveInstance-1296001899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:58:54Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'pci_devices' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 18:59:01 user nova-compute[75634]:   <uuid>d2ab1727-c3ab-4aad-801f-ce02290fc9dd</uuid>
Nov 15 18:59:01 user nova-compute[75634]:   <name>instance-0000002f</name>
Nov 15 18:59:01 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 18:59:01 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 18:59:01 user nova-compute[75634]:   <metadata>
Nov 15 18:59:01 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 18:59:01 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 18:59:01 user nova-compute[75634]:       <nova:name>tempest-TestShelveInstance-server-1126242064</nova:name>
Nov 15 18:59:01 user nova-compute[75634]:       <nova:creationTime>2023-11-15 18:58:59</nova:creationTime>
Nov 15 18:59:01 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 18:59:01 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 18:59:01 user nova-compute[75634]:       </nova:flavor>
Nov 15 18:59:01 user nova-compute[75634]:       <nova:owner>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:user uuid="d7ffd656a0cc4f579c03d651715433d1">tempest-TestShelveInstance-437679720-project-member</nova:user>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:project uuid="13a864fca2b14cb7b073b3f8574ea9b8">tempest-TestShelveInstance-437679720</nova:project>
Nov 15 18:59:01 user nova-compute[75634]:       </nova:owner>
Nov 15 18:59:01 user nova-compute[75634]:       <nova:ports>
Nov 15 18:59:01 user nova-compute[75634]:         <nova:port uuid="b21652aa-9edb-45d7-951a-788920656c0f">
Nov 15 18:59:01 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 18:59:01 user nova-compute[75634]:         </nova:port>
Nov 15 18:59:01 user nova-compute[75634]:       </nova:ports>
Nov 15 18:59:01 user nova-compute[75634]:     </nova:instance>
Nov 15 18:59:01 user nova-compute[75634]:   </metadata>
Nov 15 18:59:01 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 18:59:01 user nova-compute[75634]:     <system>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="serial">d2ab1727-c3ab-4aad-801f-ce02290fc9dd</entry>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="uuid">d2ab1727-c3ab-4aad-801f-ce02290fc9dd</entry>
Nov 15 18:59:01 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 18:59:01 user nova-compute[75634]:     </system>
Nov 15 18:59:01 user nova-compute[75634]:   </sysinfo>
Nov 15 18:59:01 user nova-compute[75634]:   <os>
Nov 15 18:59:01 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 18:59:01 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 18:59:01 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 18:59:01 user nova-compute[75634]:   </os>
Nov 15 18:59:01 user nova-compute[75634]:   <features>
Nov 15 18:59:01 user nova-compute[75634]:     <acpi/>
Nov 15 18:59:01 user nova-compute[75634]:     <apic/>
Nov 15 18:59:01 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 18:59:01 user nova-compute[75634]:   </features>
Nov 15 18:59:01 user nova-compute[75634]:   <clock offset="utc">
Nov 15 18:59:01 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 18:59:01 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 18:59:01 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 18:59:01 user nova-compute[75634]:   </clock>
Nov 15 18:59:01 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 18:59:01 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 18:59:01 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 18:59:01 user nova-compute[75634]:   </cpu>
Nov 15 18:59:01 user nova-compute[75634]:   <devices>
Nov 15 18:59:01 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 18:59:01 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:59:01 user nova-compute[75634]:       <source dev="/dev/sdd"/>
Nov 15 18:59:01 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 18:59:01 user nova-compute[75634]:       <serial>65bcff69-6349-4196-9987-6dce55b5e708</serial>
Nov 15 18:59:01 user nova-compute[75634]:     </disk>
Nov 15 18:59:01 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 18:59:01 user nova-compute[75634]:       <mac address="fa:16:3e:43:99:45"/>
Nov 15 18:59:01 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:59:01 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 18:59:01 user nova-compute[75634]:       <target dev="tapb21652aa-9e"/>
Nov 15 18:59:01 user nova-compute[75634]:     </interface>
Nov 15 18:59:01 user nova-compute[75634]:     <serial type="pty">
Nov 15 18:59:01 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd/console.log" append="off"/>
Nov 15 18:59:01 user nova-compute[75634]:     </serial>
Nov 15 18:59:01 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 18:59:01 user nova-compute[75634]:     <video>
Nov 15 18:59:01 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 18:59:01 user nova-compute[75634]:     </video>
Nov 15 18:59:01 user nova-compute[75634]:     <rng model="virtio">
Nov 15 18:59:01 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 18:59:01 user nova-compute[75634]:     </rng>
Nov 15 18:59:01 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 18:59:01 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 18:59:01 user nova-compute[75634]:       <stats period="10"/>
Nov 15 18:59:01 user nova-compute[75634]:     </memballoon>
Nov 15 18:59:01 user nova-compute[75634]:   </devices>
Nov 15 18:59:01 user nova-compute[75634]: </domain>
Nov 15 18:59:01 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF07aZw0gcQjxvDbxvWlrt1WG+o2A2KaYtKUkHChzTsIPcmaxSCBPAIGMyetWzOgKbVLfWnZSsG9gYi11dH9zt6mprU2yfb/XESkkRPSKQHfH3N/mwYqVQ7nd+XEwvjhVA==',key_name='tempest-TestShelveInstance-1296001899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:58:54Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG os_vif [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea91966d-e24f-575b-ab12-db6c2e629d62', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb21652aa-9e, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb21652aa-9e, col_values=(('qos', UUID('3d582444-d3e6-4d05-a639-f96418af346a')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb21652aa-9e, col_values=(('external_ids', {'iface-id': 'b21652aa-9edb-45d7-951a-788920656c0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:99:45', 'vm-uuid': 'd2ab1727-c3ab-4aad-801f-ce02290fc9dd'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:01 user nova-compute[75634]: INFO os_vif [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e')
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] No VIF found with MAC fa:16:3e:43:99:45, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 18:59:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:02 user nova-compute[75634]: DEBUG nova.compute.manager [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:59:02 user nova-compute[75634]: WARNING nova.compute.manager [req-992f01dc-1de1-47ae-a3bc-2337f0558846 req-ec81ba96-e34d-4c43-89a4-4abf92ab46a2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state building and task_state spawning.
Nov 15 18:59:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:59:04 user nova-compute[75634]: WARNING nova.compute.manager [req-9bd67d03-1a72-40f5-9910-071f5484b9b1 req-78b6564d-1394-4cbd-befd-2266e3b3ab01 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state building and task_state spawning.
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 18:59:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance spawned successfully.
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 18:59:05 user nova-compute[75634]: INFO nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 15 18:59:05 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 18:59:05 user nova-compute[75634]: INFO nova.compute.manager [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Took 11.82 seconds to build instance.
Nov 15 18:59:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2c631578-3e7d-4040-92b7-512b9cf9e27f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.920s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing instance network info cache due to event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updated VIF entry in instance network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-952f8d73-fb64-4fe5-a242-58e48704b01a req-35aa91bb-8b8e-48b8-a267-8f55deabfee8 service nova] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:19 user nova-compute[75634]: INFO nova.compute.manager [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Detaching volume d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:59:19 user nova-compute[75634]: INFO nova.virt.block_device [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Attempting to driver detach volume d7198ea8-adf9-4fb0-9408-a6693b42efe9 from mountpoint /dev/vdb
Nov 15 18:59:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Attempting to detach device vdb from instance 538aaff2-3904-4638-a624-36c9fee87a2d from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 18:59:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:59:19 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:59:19 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:59:19 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:59:19 user nova-compute[75634]:   <serial>d7198ea8-adf9-4fb0-9408-a6693b42efe9</serial>
Nov 15 18:59:19 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:59:19 user nova-compute[75634]: </disk>
Nov 15 18:59:19 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:59:19 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully detached device vdb from instance 538aaff2-3904-4638-a624-36c9fee87a2d from the persistent domain config.
Nov 15 18:59:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 538aaff2-3904-4638-a624-36c9fee87a2d from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 18:59:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 18:59:19 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 18:59:19 user nova-compute[75634]:   <source dev="/dev/sdg"/>
Nov 15 18:59:19 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 18:59:19 user nova-compute[75634]:   <serial>d7198ea8-adf9-4fb0-9408-a6693b42efe9</serial>
Nov 15 18:59:19 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 18:59:19 user nova-compute[75634]: </disk>
Nov 15 18:59:19 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 18:59:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG nova.compute.manager [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing instance network info cache due to event network-changed-01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] Acquiring lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] Acquired lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG nova.network.neutron [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Refreshing network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG nova.network.neutron [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updated VIF entry in instance network info cache for port 01cc67d7-ff33-4c0b-a21f-ebb0890d3686. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG nova.network.neutron [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [{"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:59:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-44c018e9-970b-4700-9d7c-8992c890fb37 req-a795a609-a001-491e-9fd7-c46739522ea1 service nova] Releasing lock "refresh_cache-538aaff2-3904-4638-a624-36c9fee87a2d" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:59:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:35 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 538aaff2-3904-4638-a624-36c9fee87a2d is timed out.
Nov 15 18:59:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully detached device vdb from instance 538aaff2-3904-4638-a624-36c9fee87a2d from the live domain config.
Nov 15 18:59:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecFoAnTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 18:59:39 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbec3d6-85f1-43eb-ad56-4b13688e7bd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 18:59:39 user nova-compute[75634]: No targets found.
Nov 15 18:59:39 user nova-compute[75634]: iSNS:
Nov 15 18:59:39 user nova-compute[75634]: No targets found.
Nov 15 18:59:39 user nova-compute[75634]: STATIC:
Nov 15 18:59:39 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 18:59:39 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:59:39 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:59:39 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e
Nov 15 18:59:39 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:59:39 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:59:39 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 18:59:39 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:59:39 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:59:39 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9
Nov 15 18:59:39 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:59:39 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:59:39 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 18:59:39 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 18:59:39 user nova-compute[75634]:                 Iface Name: default
Nov 15 18:59:39 user nova-compute[75634]: FIRMWARE:
Nov 15 18:59:39 user nova-compute[75634]: No targets found.
Nov 15 18:59:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 18:59:39 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 18:59:39 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae2515-04a5-4d7d-a5ce-bc7492d2014a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f23855-56f1-49eb-9374-796be648fb73]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 18:59:39 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 18:59:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68297ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9'): ({'sdg'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Removing single pathed devices sdg {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a64c92-3f91-4602-97bc-12a04f49e21f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cedf5f4-1da8-4851-8ce0-a826e80b608e]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Flushing IO for device /dev/sdg {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fcb46-80fc-40a3-8904-5ac08efa2edb]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d98b57a-56fa-4e75-b6e3-87a67dfc3378]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] SCSI volumes sdg have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afbd538-87f2-45ea-a945-77835b5a8041]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c06f5-8641-4867-bef0-ecb5e6fc5377]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260]
Nov 15 18:59:39 user nova-compute[75634]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9, portal: 172.16.0.220,3260] successful.
Nov 15 18:59:39 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7198ea8-adf9-4fb0-9408-a6693b42efe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93190e2-2e48-4667-84b1-023f49066a8f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] <== disconnect_volume: return (367ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 18:59:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'flavor' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:59:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:59:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 18:59:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=7543MB free_disk=24.725173950195312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1379763b-ea9e-4d25-bd21-26e44bd33906 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.947s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d324a863-5fde-4342-815f-da9a158d5df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 538aaff2-3904-4638-a624-36c9fee87a2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db6e015d-0328-4524-8f25-79ef5f54ef40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0a2942f6-8bcd-4256-bd67-dab571bd689b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 18:59:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [{"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 18:59:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:44 user nova-compute[75634]: INFO nova.compute.manager [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Terminating instance
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-unplugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] No waiting events found dispatching network-vif-unplugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.compute.manager [req-3853f2a5-2a23-494b-90a4-6f9f2c3a45a7 req-6217e69a-8bec-4dd4-a253-6001063962fb service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-unplugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Instance destroyed successfully.
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.objects.instance [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid d324a863-5fde-4342-815f-da9a158d5df7 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1527921557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1527921557',id=37,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-l0f2a0h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:52:19Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=d324a863-5fde-4342-815f-da9a158d5df7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "address": "fa:16:3e:b6:43:b9", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca729026-e4", "ovs_interfaceid": "ca729026-e47e-4d10-affa-3e3b0c8a9faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG os_vif [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca729026-e4, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efa2b4d1-5996-48af-96be-7717afd4d0e8) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:44 user nova-compute[75634]: INFO os_vif [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:43:b9,bridge_name='br-int',has_traffic_filtering=True,id=ca729026-e47e-4d10-affa-3e3b0c8a9faf,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca729026-e4')
Nov 15 18:59:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Deleting instance files /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7_del
Nov 15 18:59:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Deletion of /opt/stack/data/nova/instances/d324a863-5fde-4342-815f-da9a158d5df7_del complete
Nov 15 18:59:45 user nova-compute[75634]: INFO nova.compute.manager [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 18:59:45 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 18:59:45 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Took 0.63 seconds to deallocate network for instance.
Nov 15 18:59:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-e75c9da6-8f09-4965-8118-1b5a30a440db req-7b8046c6-b064-46c3-804f-eddf1d7afd18 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-deleted-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:45 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:46 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Deleted allocations for instance d324a863-5fde-4342-815f-da9a158d5df7
Nov 15 18:59:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-df6b91c4-bada-4775-9cfc-6544b0bc1fe2 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "d324a863-5fde-4342-815f-da9a158d5df7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.036s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] Acquiring lock "d324a863-5fde-4342-815f-da9a158d5df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] Lock "d324a863-5fde-4342-815f-da9a158d5df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 18:59:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] No waiting events found dispatching network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 18:59:46 user nova-compute[75634]: WARNING nova.compute.manager [req-05b511bb-d74f-4238-b138-1aa1c2e4e546 req-97aebd8b-678d-4e05-83b3-7335135c9d62 service nova] [instance: d324a863-5fde-4342-815f-da9a158d5df7] Received unexpected event network-vif-plugged-ca729026-e47e-4d10-affa-3e3b0c8a9faf for instance with vm_state deleted and task_state None.
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:59:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 18:59:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:09 user nova-compute[75634]: INFO nova.compute.manager [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Terminating instance
Nov 15 19:00:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG nova.compute.manager [req-4ca80fa9-0119-43f4-bf3a-ca940d1c993d req-34f8d43e-e286-4d1b-8119-e69d4b9d9e57 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-unplugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Instance destroyed successfully.
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.objects.instance [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid 538aaff2-3904-4638-a624-36c9fee87a2d {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-279912819',display_name='tempest-ServerRescueNegativeTestJSON-server-279912819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-279912819',id=42,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKe6FRSwbyKr2hLUmb5k1aqFzWqHw3DorcgFPnimfcB12lUevYE7nsW5gi9GbXPJLE4rOEGbYKFOBAWecQwe+6E+Y728lkjEOJXDrB3GHvrRY3mwii7/u+M4XX4NXEKhg==',key_name='tempest-keypair-425341621',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-98227wgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395915213ac442edbdd3d80e03367744',uuid=538aaff2-3904-4638-a624-36c9fee87a2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "address": "fa:16:3e:28:b4:7b", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cc67d7-ff", "ovs_interfaceid": "01cc67d7-ff33-4c0b-a21f-ebb0890d3686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG os_vif [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01cc67d7-ff, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08da0f76-5e6a-4011-b3e2-c751b6249aff) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:10 user nova-compute[75634]: INFO os_vif [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b4:7b,bridge_name='br-int',has_traffic_filtering=True,id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cc67d7-ff')
Nov 15 19:00:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Deleting instance files /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d_del
Nov 15 19:00:10 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Deletion of /opt/stack/data/nova/instances/538aaff2-3904-4638-a624-36c9fee87a2d_del complete
Nov 15 19:00:10 user nova-compute[75634]: INFO nova.compute.manager [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 19:00:10 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:00:10 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:11 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Took 0.82 seconds to deallocate network for instance.
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-313e89f2-d5bb-4b62-80a9-904b270d26e5 req-77037ae0-a4ba-476c-ae49-431174f088a2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-deleted-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:11 user nova-compute[75634]: INFO nova.compute.manager [req-313e89f2-d5bb-4b62-80a9-904b270d26e5 req-77037ae0-a4ba-476c-ae49-431174f088a2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Neutron deleted interface 01cc67d7-ff33-4c0b-a21f-ebb0890d3686; detaching it from the instance and deleting it from the info cache
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-313e89f2-d5bb-4b62-80a9-904b270d26e5 req-77037ae0-a4ba-476c-ae49-431174f088a2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-313e89f2-d5bb-4b62-80a9-904b270d26e5 req-77037ae0-a4ba-476c-ae49-431174f088a2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Detach interface failed, port_id=01cc67d7-ff33-4c0b-a21f-ebb0890d3686, reason: Instance 538aaff2-3904-4638-a624-36c9fee87a2d could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:11 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Deleted allocations for instance 538aaff2-3904-4638-a624-36c9fee87a2d
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-63a2abbd-981b-4e01-932a-6e02b3530e70 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "538aaff2-3904-4638-a624-36c9fee87a2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] Acquiring lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] Lock "538aaff2-3904-4638-a624-36c9fee87a2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:11 user nova-compute[75634]: DEBUG nova.compute.manager [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] No waiting events found dispatching network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:11 user nova-compute[75634]: WARNING nova.compute.manager [req-db2a4903-ece5-4a79-a499-49e8da3a82ba req-a4ac9267-9b9c-43a3-a0e4-b15a490506e2 service nova] [instance: 538aaff2-3904-4638-a624-36c9fee87a2d] Received unexpected event network-vif-plugged-01cc67d7-ff33-4c0b-a21f-ebb0890d3686 for instance with vm_state deleted and task_state None.
Nov 15 19:00:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG nova.objects.instance [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'flavor' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:15 user nova-compute[75634]: INFO nova.compute.manager [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attaching volume 2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 to /dev/vdb
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.utils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e5348-2834-4ad9-93a5-d7020bdabc1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[83706125-392c-43ec-8770-808164562619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44265d2-2011-4003-8f71-3074719c50b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cbaccc-f1e8-4a37-a249-89745b951284]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:00:15 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:00:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8dfdfb-6ec7-4263-924c-15170825f775]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG os_brick.utils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:15 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating existing volume attachment record: b1fcb666-a41c-488e-a85e-8fe61f056b0b {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:20 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:20 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:20 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24f300-0f4d-40e4-bdca-04596dd11a4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:00:20 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5cbb4-865f-4ec7-9a6d-8ba76fccde9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5] added
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaa8280-5b9f-41ac-b835-7d59578d5f33]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c061904e-a48b-43ad-90ab-71fa51d8dc06]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShXdyHMY {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShXdyHMY" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee21c0c-1cbb-411e-b143-573e851ec452]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShXdyHMY'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a106950b-52a7-44ca-aaea-5a158a5da570]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac75e0-8e2f-4e90-a3c9-56d8c700aff1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3da5cf2-08f9-4458-a8b5-c4d952d6d2c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260]
Nov 15 19:00:20 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260] successful.
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e01625-09da-4199-b080-a6faac2b08cf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9251a3-7c52-4233-9480-9a53be1fd59a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:20 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] HCTL ('37', '-', '-', 0) found on session 59 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2bec51-0ec9-47a7-8f48-729a4a5d945c]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:20 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching for a device in session 59 and hctl ['37', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching for a device in session 59 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23765333363373233', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333363373233', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG nova.objects.instance [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'flavor' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:00:21 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:00:21 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 19:00:21 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:00:21 user nova-compute[75634]:   <serial>2e1aad64-6d15-4d47-b42f-a10bc2fb75d5</serial>
Nov 15 19:00:21 user nova-compute[75634]: </disk>
Nov 15 19:00:21 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:00:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:00:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:00:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No VIF found with MAC fa:16:3e:9f:53:8f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:00:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-50a07dc8-6172-439e-81fc-e7104eb66af1 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.863s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:23 user nova-compute[75634]: INFO nova.compute.manager [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Rescuing
Nov 15 19:00:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG nova.compute.manager [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:24 user nova-compute[75634]: WARNING nova.compute.manager [req-4df27773-25cb-4514-9442-6c1a20b5063d req-7b19c2e4-3dd4-4c10-9e2e-4b15b3a948f7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state active and task_state rescuing.
Nov 15 19:00:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance destroyed successfully.
Nov 15 19:00:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attempting a stable device rescue
Nov 15 19:00:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75634) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance directory exists: not creating {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 19:00:24 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Creating image(s)
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:24 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.part --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG nova.virt.images [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] 17e4f151-b4a9-4b1f-b0a8-cf9868f1ab04 was qcow2, converting to raw {{(pid=75634) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG nova.privsep.utils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75634) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 19:00:25 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.part /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.converted {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:26 user nova-compute[75634]: WARNING nova.compute.manager [req-f35277d0-0722-4865-9be0-5973a749f5b4 req-1ed46bbb-f151-40aa-9bc5-6ee854da00e7 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state active and task_state rescuing.
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:26 user nova-compute[75634]: INFO nova.compute.manager [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Terminating instance
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.part /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.converted" returned: 0 in 0.561s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.converted --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.079s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG nova.compute.manager [req-58a9b8c6-56f3-46f0-9b8c-d9ea0d3d37b5 req-0a4e85a0-ec7f-4610-b333-ebad33be41cb service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-unplugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3,backing_fmt=raw /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3,backing_fmt=raw /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue" returned: 0 in 0.052s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "6656b8db79b16d9685dc553268a7b2c661ffa8d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'migration_context' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Object Instance<ae61a358-95d3-4d6f-a127-fb2bacd88afa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start _get_guest_xml network_info=[{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "vif_mac": "fa:16:3e:9f:53:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17e4f151-b4a9-4b1f-b0a8-cf9868f1ab04', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ae61a358-95d3-4d6f-a127-fb2bacd88afa', 'attached_at': '', 'detached_at': '', 'volume_id': '2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'serial': '2e1aad64-6d15-4d47-b42f-a10bc2fb75d5'}, 'guest_format': None, 'boot_index': None, 'attachment_id': 'b1fcb666-a41c-488e-a85e-8fe61f056b0b', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'resources' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Object Instance<ae61a358-95d3-4d6f-a127-fb2bacd88afa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'numa_topology' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Object Instance<ae61a358-95d3-4d6f-a127-fb2bacd88afa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:00:27 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Object Instance<ae61a358-95d3-4d6f-a127-fb2bacd88afa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:27 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:27 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:27 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ccc795-5f52-46b3-8474-01d7f8c53d50]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ShXdyHMY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 19:00:27 user nova-compute[75634]: node.name = iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:00:27 user nova-compute[75634]: node.tpgt = -1
Nov 15 19:00:27 user nova-compute[75634]: node.startup = automatic
Nov 15 19:00:27 user nova-compute[75634]: node.leading_login = No
Nov 15 19:00:27 user nova-compute[75634]: iface.iscsi_ifacename = default
Nov 15 19:00:27 user nova-compute[75634]: iface.net_ifacename = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.ipaddress = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.prefix_len = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.hwaddress = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.transport_name = tcp
Nov 15 19:00:27 user nova-compute[75634]: iface.initiatorname = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.vlan_id = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.vlan_priority = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.vlan_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.iface_num = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.mtu = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.port = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.bootproto = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.subnet_mask = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.gateway = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_alt_client_id = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_dns = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_learn_iqn = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_vendor_id_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_vendor_id = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.dhcp_slp_da = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.fragmentation = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.gratuitous_arp = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.incoming_forwarding = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.tos_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.tos = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.ttl = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.delayed_ack = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.tcp_nagle = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.tcp_wsf_state = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.tcp_wsf = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.tcp_timer_scale = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.tcp_timestamp = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.redirect = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.def_task_mgmt_timeout = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.header_digest = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.data_digest = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.immediate_data = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.initial_r2t = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.data_seq_inorder = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.data_pdu_inorder = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.erl = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.max_receive_data_len = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.first_burst_len = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.max_outstanding_r2t = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.max_burst_len = 0
Nov 15 19:00:27 user nova-compute[75634]: iface.chap_auth = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.bidi_chap = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.strict_login_compliance = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.discovery_auth = <empty>
Nov 15 19:00:27 user nova-compute[75634]: iface.discovery_logout = <empty>
Nov 15 19:00:27 user nova-compute[75634]: node.discovery_address = <empty>
Nov 15 19:00:27 user nova-compute[75634]: node.discovery_port = 0
Nov 15 19:00:27 user nova-compute[75634]: node.discovery_type = static
Nov 15 19:00:27 user nova-compute[75634]: node.session.initial_cmdsn = 0
Nov 15 19:00:27 user nova-compute[75634]: node.session.initial_login_retry_max = 8
Nov 15 19:00:27 user nova-compute[75634]: node.session.xmit_thread_priority = -20
Nov 15 19:00:27 user nova-compute[75634]: node.session.cmds_max = 128
Nov 15 19:00:27 user nova-compute[75634]: node.session.queue_depth = 32
Nov 15 19:00:27 user nova-compute[75634]: node.session.nr_sessions = 1
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.authmethod = CHAP
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.username = ShXdyHMY
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.password = ***
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.username_in = <empty>
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.password_in = <empty>
Nov 15 19:00:27 user nova-compute[75634]: node.session.auth.chap_algs = MD5
Nov 15 19:00:27 user nova-compute[75634]: node.session.timeo.replacement_timeout = 120
Nov 15 19:00:27 user nova-compute[75634]: node.session.err_timeo.abort_timeout = 15
Nov 15 19:00:27 user nova-compute[75634]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 19:00:27 user nova-compute[75634]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 19:00:27 user nova-compute[75634]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.FastAbort = Yes
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.InitialR2T = No
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.ImmediateData = Yes
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.MaxConnections = 1
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 19:00:27 user nova-compute[75634]: node.session.iscsi.ERL = 0
Nov 15 19:00:27 user nova-compute[75634]: node.session.scan = manual
Nov 15 19:00:27 user nova-compute[75634]: node.session.reopen_max = 0
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].address = 172.16.0.220
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].port = 3260
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].startup = manual
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].tcp.window_size = 524288
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].tcp.type_of_service = 0
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].timeo.logout_timeout = 15
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].timeo.login_timeout = 15
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].timeo.auth_timeout = 45
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.DataDigest = None
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.IFMarker = No
Nov 15 19:00:27 user nova-compute[75634]: node.conn[0].iscsi.OFMarker = No
Nov 15 19:00:27 user nova-compute[75634]: # END RECORD
Nov 15 19:00:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Instance destroyed successfully.
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'resources' on Instance uuid 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-643925418',display_name='tempest-AttachVolumeTestJSON-server-643925418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-643925418',id=38,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAR3eNgPuSpTzMdqVG1qSIHMAaTc6oNX6sbeXthanxXUtpEw7Tg61zmDh6Ngvcl4kgawiZHXvI6TdyOjuim/UJR+4S8j3djk5MrGVaj6+B6HzGKKSzvzISdA62vIonKg==',key_name='tempest-keypair-45494305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-zjfcfxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "address": "fa:16:3e:d2:0b:cc", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb27d8-ed", "ovs_interfaceid": "dcfb27d8-ed70-4d06-a254-0dd85a62cde1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_vif [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c85c9-1304-4d9d-9458-b83678edce07]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcfb27d8-ed, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e892f282-360a-461d-8ef3-e793cd6dfc7c) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[19805328-9c2c-48d5-a4b0-df4465fa4b81]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShXdyHMY {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:27 user nova-compute[75634]: INFO os_vif [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0b:cc,bridge_name='br-int',has_traffic_filtering=True,id=dcfb27d8-ed70-4d06-a254-0dd85a62cde1,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb27d8-ed')
Nov 15 19:00:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Deleting instance files /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6_del
Nov 15 19:00:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Deletion of /opt/stack/data/nova/instances/1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6_del complete
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShXdyHMY" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae700a3-9148-4ad9-bc5e-3648d5241087]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShXdyHMY'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad7f1b-e5f1-4829-931b-68872341a102]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a47e01-946a-4666-ab10-7d7d152f3ad5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] HCTL ('37', '0', '0', 0) found on session 59 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:27 user nova-compute[75634]: INFO nova.compute.manager [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0528fb79-aa17-4228-9e58-4ac6f8900686]: (4, ('0 0 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Searching for a device in session 59 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.177s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23765333363373233', 'path': '/dev/sdf'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333363373233', 'path': '/dev/sdf'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-285015549',display_name='tempest-ServerStableDeviceRescueTest-server-285015549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-285015549',id=44,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZX9edWOakXvTWec1sJJQeU3ZnjwvYevllHIUyQIxaVB0yft859vc0IgXJtsX53aLJUn8u5Gd3WfUxNpLBYsBpVv7ljGGT42x1GsEsBqn/jyIqChF03q4brUFZNRUkbA==',key_name='tempest-keypair-458089163',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3ecd8bd04f64bec81495973abc55d4c',ramdisk_id='',reservation_id='r-wmukpqpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1481719976',owner_user_name='tempest-ServerStableDeviceRescueTest-1481719976-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T18:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bb03f0f7e14a35990cb0378b225f66',uuid=ae61a358-95d3-4d6f-a127-fb2bacd88afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "vif_mac": "fa:16:3e:9f:53:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converting VIF {"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "vif_mac": "fa:16:3e:9f:53:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'pci_devices' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.objects.base [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Object Instance<ae61a358-95d3-4d6f-a127-fb2bacd88afa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:00:27 user nova-compute[75634]:   <uuid>ae61a358-95d3-4d6f-a127-fb2bacd88afa</uuid>
Nov 15 19:00:27 user nova-compute[75634]:   <name>instance-0000002c</name>
Nov 15 19:00:27 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:00:27 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:00:27 user nova-compute[75634]:   <metadata>
Nov 15 19:00:27 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:00:27 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-285015549</nova:name>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:00:27</nova:creationTime>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:00:27 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:00:27 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:owner>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:user uuid="70bb03f0f7e14a35990cb0378b225f66">tempest-ServerStableDeviceRescueTest-1481719976-project-member</nova:user>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:project uuid="c3ecd8bd04f64bec81495973abc55d4c">tempest-ServerStableDeviceRescueTest-1481719976</nova:project>
Nov 15 19:00:27 user nova-compute[75634]:       </nova:owner>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:00:27 user nova-compute[75634]:       <nova:ports>
Nov 15 19:00:27 user nova-compute[75634]:         <nova:port uuid="4cf8faf0-cb34-443e-b98c-0ea6048aeef7">
Nov 15 19:00:27 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 19:00:27 user nova-compute[75634]:         </nova:port>
Nov 15 19:00:27 user nova-compute[75634]:       </nova:ports>
Nov 15 19:00:27 user nova-compute[75634]:     </nova:instance>
Nov 15 19:00:27 user nova-compute[75634]:   </metadata>
Nov 15 19:00:27 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:00:27 user nova-compute[75634]:     <system>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="serial">ae61a358-95d3-4d6f-a127-fb2bacd88afa</entry>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="uuid">ae61a358-95d3-4d6f-a127-fb2bacd88afa</entry>
Nov 15 19:00:27 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:00:27 user nova-compute[75634]:     </system>
Nov 15 19:00:27 user nova-compute[75634]:   </sysinfo>
Nov 15 19:00:27 user nova-compute[75634]:   <os>
Nov 15 19:00:27 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:00:27 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:00:27 user nova-compute[75634]:   </os>
Nov 15 19:00:27 user nova-compute[75634]:   <features>
Nov 15 19:00:27 user nova-compute[75634]:     <acpi/>
Nov 15 19:00:27 user nova-compute[75634]:     <apic/>
Nov 15 19:00:27 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:00:27 user nova-compute[75634]:   </features>
Nov 15 19:00:27 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:00:27 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:00:27 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:00:27 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:00:27 user nova-compute[75634]:   </clock>
Nov 15 19:00:27 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:00:27 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:00:27 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:00:27 user nova-compute[75634]:   </cpu>
Nov 15 19:00:27 user nova-compute[75634]:   <devices>
Nov 15 19:00:27 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:00:27 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:00:27 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk"/>
Nov 15 19:00:27 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:00:27 user nova-compute[75634]:     </disk>
Nov 15 19:00:27 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 19:00:27 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:00:27 user nova-compute[75634]:       <source dev="/dev/sdf"/>
Nov 15 19:00:27 user nova-compute[75634]:       <target dev="vdb" bus="virtio"/>
Nov 15 19:00:27 user nova-compute[75634]:       <serial>2e1aad64-6d15-4d47-b42f-a10bc2fb75d5</serial>
Nov 15 19:00:27 user nova-compute[75634]:     </disk>
Nov 15 19:00:27 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:00:27 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:00:27 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue"/>
Nov 15 19:00:27 user nova-compute[75634]:       <target dev="vdc" bus="virtio"/>
Nov 15 19:00:27 user nova-compute[75634]:       <boot order="1"/>
Nov 15 19:00:27 user nova-compute[75634]:     </disk>
Nov 15 19:00:27 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:00:27 user nova-compute[75634]:       <mac address="fa:16:3e:9f:53:8f"/>
Nov 15 19:00:27 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:00:27 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:00:27 user nova-compute[75634]:       <target dev="tap4cf8faf0-cb"/>
Nov 15 19:00:27 user nova-compute[75634]:     </interface>
Nov 15 19:00:27 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:00:27 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/console.log" append="off"/>
Nov 15 19:00:27 user nova-compute[75634]:     </serial>
Nov 15 19:00:27 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:00:27 user nova-compute[75634]:     <video>
Nov 15 19:00:27 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:00:27 user nova-compute[75634]:     </video>
Nov 15 19:00:27 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:00:27 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:00:27 user nova-compute[75634]:     </rng>
Nov 15 19:00:27 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:00:27 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:00:27 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:00:27 user nova-compute[75634]:     </memballoon>
Nov 15 19:00:27 user nova-compute[75634]:   </devices>
Nov 15 19:00:27 user nova-compute[75634]: </domain>
Nov 15 19:00:27 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:00:27 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance destroyed successfully.
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:00:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] No VIF found with MAC fa:16:3e:9f:53:8f, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:28 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Took 1.01 seconds to deallocate network for instance.
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:28 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Deleted allocations for instance 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1d76a4e8-cceb-4a41-9a96-9bc8b58fde52 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] Acquiring lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] Lock "1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] No waiting events found dispatching network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:28 user nova-compute[75634]: WARNING nova.compute.manager [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received unexpected event network-vif-plugged-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 for instance with vm_state deleted and task_state None.
Nov 15 19:00:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-98ae3677-c117-473d-b4ca-9d5e34b02b57 req-673b8144-ad97-47f6-a5bc-d7d2877e5f91 service nova] [instance: 1b86bc2f-f781-4c82-b08c-2d7fdbd04ad6] Received event network-vif-deleted-dcfb27d8-ed70-4d06-a254-0dd85a62cde1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG nova.compute.manager [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:29 user nova-compute[75634]: WARNING nova.compute.manager [req-81bf1c4f-c0bc-466f-8825-3f517d6e3d2a req-9ae15e59-fe49-4d52-8620-55247934df3c service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state active and task_state rescuing.
Nov 15 19:00:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:31 user nova-compute[75634]: WARNING nova.compute.manager [req-b18ea4a7-a845-4daf-8e91-f00a9d6920a0 req-8c2a8f97-8fff-47f7-99a8-b9e2e353ec95 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state active and task_state rescuing.
Nov 15 19:00:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c28a8fb0-d504-419f-ad7e-86c6e22a824a tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:00:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:34 user nova-compute[75634]: INFO nova.compute.manager [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Terminating instance
Nov 15 19:00:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-26d7dde4-872b-4b05-8f9b-a884fd652774 req-17915539-ae4d-459d-ba98-9e99d9c30dd0 service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-unplugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:00:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Instance destroyed successfully.
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid 0ecd19a3-6712-411c-94fe-bdc95fc2b28c {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1145365935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1145365935',id=25,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-elq2iktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:48:37Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=0ecd19a3-6712-411c-94fe-bdc95fc2b28c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "address": "fa:16:3e:05:c3:10", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2f6f12-99", "ovs_interfaceid": "cb2f6f12-998b-4f5b-9e86-d068d4dedd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_vif [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb2f6f12-99, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6711455d-5fec-49b5-9528-6fb9c4a0a311) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:35 user nova-compute[75634]: INFO os_vif [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c3:10,bridge_name='br-int',has_traffic_filtering=True,id=cb2f6f12-998b-4f5b-9e86-d068d4dedd31,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2f6f12-99')
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrLnmHVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:35 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b772ce-c443-4fca-9d9a-fdffc34791d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:00:35 user nova-compute[75634]: No targets found.
Nov 15 19:00:35 user nova-compute[75634]: iSNS:
Nov 15 19:00:35 user nova-compute[75634]: No targets found.
Nov 15 19:00:35 user nova-compute[75634]: STATIC:
Nov 15 19:00:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:00:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e
Nov 15 19:00:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 19:00:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:00:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358
Nov 15 19:00:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:35 user nova-compute[75634]: FIRMWARE:
Nov 15 19:00:35 user nova-compute[75634]: No targets found.
Nov 15 19:00:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:00:35 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:00:35 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d490b20-0cbf-410e-8ecf-4ca5f4b76048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001be40-8982-4d59-8776-36a47042e85a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4417c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076eb58-7035-4664-b721-f6e65eb2c273]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf22333-6e70-40af-852d-aab1e422b43f]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[def15634-a85d-4ad5-83af-08cf863a2405]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92d8f3-092e-4739-bfc6-ee850da59840]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb12f7-cb4a-4451-a505-c3df7d8e0ade]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f3a7a5-3350-43a6-84e1-044b1561efea]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260]
Nov 15 19:00:35 user nova-compute[75634]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358, portal: 172.16.0.220,3260] successful.
Nov 15 19:00:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab816fd-fb1d-4a4a-b41f-86983a223358 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c336fca-ea64-49f7-8da8-fc19e6ac015a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] <== disconnect_volume: return (314ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:00:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Deleting instance files /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c_del
Nov 15 19:00:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Deletion of /opt/stack/data/nova/instances/0ecd19a3-6712-411c-94fe-bdc95fc2b28c_del complete
Nov 15 19:00:35 user nova-compute[75634]: INFO nova.compute.manager [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 19:00:35 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:00:35 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:00:36 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:36 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Took 0.39 seconds to deallocate network for instance.
Nov 15 19:00:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] Acquiring lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] No waiting events found dispatching network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:37 user nova-compute[75634]: WARNING nova.compute.manager [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received unexpected event network-vif-plugged-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 for instance with vm_state active and task_state deleting.
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-c1af6030-6688-4d72-a693-032e7256248d req-d1056073-87a7-4b74-aa3c-410df1d2e2af service nova] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Received event network-vif-deleted-cb2f6f12-998b-4f5b-9e86-d068d4dedd31 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:37 user nova-compute[75634]: INFO nova.compute.manager [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 0ecd19a3-6712-411c-94fe-bdc95fc2b28c] Took 0.83 seconds to detach 1 volumes for instance.
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.117s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:00:37 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Deleted allocations for instance 0ecd19a3-6712-411c-94fe-bdc95fc2b28c
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-16cdeb76-5ff8-43a2-aaba-41a788b3e246 tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "0ecd19a3-6712-411c-94fe-bdc95fc2b28c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:00:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing instance network info cache due to event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] Acquiring lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] Acquired lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG nova.network.neutron [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updated VIF entry in instance network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating instance_info_cache with network_info: [{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-55de6d4f-6a28-4247-a7a4-db6721ccf72a req-866cf32e-42fd-4b72-a032-716c4673b120 service nova] Releasing lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing instance network info cache due to event network-changed-d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] Acquiring lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] Acquired lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.network.neutron [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Refreshing network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:39 user nova-compute[75634]: INFO nova.compute.manager [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Terminating instance
Nov 15 19:00:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updated VIF entry in instance network info cache for port d9a66162-d3fa-464b-8a32-1f9ab4463b9b. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating instance_info_cache with network_info: [{"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:40 user nova-compute[75634]: WARNING nova.compute.manager [req-d9937b55-ac4e-41b0-9d29-e63d3f5b1f6a req-cc5d284c-ec55-43eb-8547-f781fa6d5d66 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state active and task_state deleting.
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec02de1a-afeb-49c5-a7ae-7197175bc48c req-1ada2662-8129-456b-b72a-d43b09008bc4 service nova] Releasing lock "refresh_cache-0a2942f6-8bcd-4256-bd67-dab571bd689b" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:40 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Instance destroyed successfully.
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid 0a2942f6-8bcd-4256-bd67-dab571bd689b {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:00:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=24.810134887695312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-233073705',display_name='tempest-TestVolumeBootPattern-server-233073705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-233073705',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:58:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-2k6kw2nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:58:59Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=0a2942f6-8bcd-4256-bd67-dab571bd689b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "address": "fa:16:3e:be:29:fc", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a66162-d3", "ovs_interfaceid": "d9a66162-d3fa-464b-8a32-1f9ab4463b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG os_vif [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a66162-d3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0b16dda-6c06-48a1-9c3f-f1d3e4a5fcda) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:40 user nova-compute[75634]: INFO os_vif [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:29:fc,bridge_name='br-int',has_traffic_filtering=True,id=d9a66162-d3fa-464b-8a32-1f9ab4463b9b,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a66162-d3')
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoFuKjdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:41 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464c01a-b970-4971-8ed5-8340bfddf9aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:00:41 user nova-compute[75634]: No targets found.
Nov 15 19:00:41 user nova-compute[75634]: iSNS:
Nov 15 19:00:41 user nova-compute[75634]: No targets found.
Nov 15 19:00:41 user nova-compute[75634]: STATIC:
Nov 15 19:00:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:00:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e
Nov 15 19:00:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 19:00:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:41 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:00:41 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:41 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:41 user nova-compute[75634]: FIRMWARE:
Nov 15 19:00:41 user nova-compute[75634]: No targets found.
Nov 15 19:00:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:00:41 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:00:41 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a57f4-02e3-4263-929c-99be7b2a9cbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab55a532-43c9-4193-b3c0-c49bffd473fb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4433da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance db6e015d-0328-4524-8f25-79ef5f54ef40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 0a2942f6-8bcd-4256-bd67-dab571bd689b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aeb301-2561-41bd-b8c0-cf691c444643]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9fa44-413b-4fdf-8e56-769b60cbd8e5]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba31f9-3ff7-40fa-a0c3-f8c373b146e4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d88381-546f-4443-a304-364d678ce2c4]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb974d52-bbdd-4d2c-a9f9-1a3ba051b3ab]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cb707-a18a-48c1-b331-f9c4bf8961f9]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260]
Nov 15 19:00:41 user nova-compute[75634]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e, portal: 172.16.0.220,3260] successful.
Nov 15 19:00:41 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e14e8b3-d62e-47a1-9590-12e6999a061e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab57d41-3a6d-4534-90a3-95942c8d5931]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (330ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:00:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Deleting instance files /opt/stack/data/nova/instances/0a2942f6-8bcd-4256-bd67-dab571bd689b_del
Nov 15 19:00:41 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Deletion of /opt/stack/data/nova/instances/0a2942f6-8bcd-4256-bd67-dab571bd689b_del complete
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:41 user nova-compute[75634]: INFO nova.compute.manager [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Took 1.80 seconds to destroy the instance on the hypervisor.
Nov 15 19:00:41 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:41 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Took 0.45 seconds to deallocate network for instance.
Nov 15 19:00:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-86b4252c-593d-4151-847a-90b2c7947d21 req-cf819912-4662-4252-911d-f1f41855c7c3 service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-deleted-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:00:42 user nova-compute[75634]: INFO nova.compute.manager [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:42 user nova-compute[75634]: WARNING nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state deleted and task_state None.
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:42 user nova-compute[75634]: WARNING nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state deleted and task_state None.
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:42 user nova-compute[75634]: WARNING nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-unplugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state deleted and task_state None.
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Acquiring lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] No waiting events found dispatching network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:42 user nova-compute[75634]: WARNING nova.compute.manager [req-6a7c3f55-6007-4626-a1b1-7885bc42775e req-b20a61c2-e658-48d7-8f07-5279dd29e19d service nova] [instance: 0a2942f6-8bcd-4256-bd67-dab571bd689b] Received unexpected event network-vif-plugged-d9a66162-d3fa-464b-8a32-1f9ab4463b9b for instance with vm_state deleted and task_state None.
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:42 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance 0a2942f6-8bcd-4256-bd67-dab571bd689b
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2e12b8c6-93f8-4b22-b028-9a067f9f1edb tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "0a2942f6-8bcd-4256-bd67-dab571bd689b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.414s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-changed-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing instance network info cache due to event network-changed-b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing network info cache for port b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updated VIF entry in instance network info cache for port b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-230ffe5a-d07b-45a2-a17e-4305cad60e3f req-92f01efe-966f-4c5c-a45e-0849e2451055 service nova] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:45 user nova-compute[75634]: INFO nova.compute.manager [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Shelve offloading
Nov 15 19:00:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:46 user nova-compute[75634]: WARNING nova.compute.manager [req-37d17b3b-cba5-4555-8950-dc122cb8aebe req-4a84cfed-d86e-419b-a937-d6cce2c7d1c0 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state shelving.
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:00:46 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance destroyed successfully.
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-changed-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing instance network info cache due to event network-changed-b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing network info cache for port b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:00:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance destroyed successfully.
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'resources' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF07aZw0gcQjxvDbxvWlrt1WG+o2A2KaYtKUkHChzTsIPcmaxSCBPAIGMyetWzOgKbVLfWnZSsG9gYi11dH9zt6mprU2yfb/XESkkRPSKQHfH3N/mwYqVQ7nd+XEwvjhVA==',key_name='tempest-TestShelveInstance-1296001899',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:59:05Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_vif [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb21652aa-9e, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d582444-d3e6-4d05-a639-f96418af346a) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:47 user nova-compute[75634]: INFO os_vif [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e')
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:00:47 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db840ba8-5fb6-47de-8887-c043f79b093b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:00:47 user nova-compute[75634]: No targets found.
Nov 15 19:00:47 user nova-compute[75634]: iSNS:
Nov 15 19:00:47 user nova-compute[75634]: No targets found.
Nov 15 19:00:47 user nova-compute[75634]: STATIC:
Nov 15 19:00:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:00:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 19:00:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:47 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:00:47 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:00:47 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:00:47 user nova-compute[75634]: FIRMWARE:
Nov 15 19:00:47 user nova-compute[75634]: No targets found.
Nov 15 19:00:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:00:47 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:00:47 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[763245eb-d99b-49cb-9934-301ec6fb1a78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb2755-5f0e-4e6c-841e-5984aa1819b5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:00:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b443160e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3e1bd2-9130-45d1-b240-cf786c0d17ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e4bec-e341-460e-9b2e-078077e9f1e4]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db55c0-5696-4edb-8f61-08fb9d526885]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f8791-7d4c-452e-92f8-f71fcf991f73]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe12e31d-c9a7-478d-a28d-a934c8136d2c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8424a29-24d3-428b-b7c3-1c6c7c3996b9]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]
Nov 15 19:00:47 user nova-compute[75634]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.
Nov 15 19:00:47 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20ea06b-0cf1-4ca9-a310-fe15bd1fc572]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== disconnect_volume: return (296ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:00:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:00:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deleting instance files /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd_del
Nov 15 19:00:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deletion of /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd_del complete
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updated VIF entry in instance network info cache for port b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.network.neutron [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": null, "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb21652aa-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c500550-64cb-40ae-a90e-2abe817a1d68 req-ade1b3a0-88fe-40ca-94b0-3fccd18135f7 service nova] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:00:48 user nova-compute[75634]: WARNING nova.compute.manager [req-b8875519-2baa-4f0a-9bf2-c101e9bb7bf3 req-5f75ca65-4734-4210-8c4b-71020e3b863a service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state shelving.
Nov 15 19:00:48 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Deleted allocations for instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.objects.instance [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'numa_topology' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:00:48 user nova-compute[75634]: DEBUG nova.objects.base [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Object Instance<d2ab1727-c3ab-4aad-801f-ce02290fc9dd> lazy-loaded attributes: resources,numa_topology {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:00:49 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:00:49 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:00:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-bb5bbc1d-1d6a-4a6e-bc3b-0e0dd9409e94 tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.380s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:00:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:00:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:00:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:04 user nova-compute[75634]: INFO nova.compute.manager [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Terminating instance
Nov 15 19:01:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.compute.manager [req-25ab0e69-1223-4966-9aa8-77e80bf4fcee req-a1342bf5-1db2-4c9f-8f89-f12cfd7d55dc service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-unplugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:01:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Instance destroyed successfully.
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936047067',display_name='tempest-ServerRescueNegativeTestJSON-server-936047067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936047067',id=27,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-muy1q36q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:47:02Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "4e3260a7-c46e-48a2-85a0-b67464a58563", "address": "fa:16:3e:d3:4c:ed", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3260a7-c4", "ovs_interfaceid": "4e3260a7-c46e-48a2-85a0-b67464a58563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG os_vif [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e3260a7-c4, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da24f246-376c-4768-9b8e-c344ccd13ba5) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:05 user nova-compute[75634]: INFO os_vif [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4c:ed,bridge_name='br-int',has_traffic_filtering=True,id=4e3260a7-c46e-48a2-85a0-b67464a58563,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3260a7-c4')
Nov 15 19:01:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Deleting instance files /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44_del
Nov 15 19:01:05 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Deletion of /opt/stack/data/nova/instances/8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44_del complete
Nov 15 19:01:05 user nova-compute[75634]: INFO nova.compute.manager [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:05 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Took 0.37 seconds to deallocate network for instance.
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:06 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:06 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:06 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Deleted allocations for instance 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44
Nov 15 19:01:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2fbe027d-da73-4998-a4b0-c6445df5fcb5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.454s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] Acquiring lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:07 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] Lock "8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] No waiting events found dispatching network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:07 user nova-compute[75634]: WARNING nova.compute.manager [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received unexpected event network-vif-plugged-4e3260a7-c46e-48a2-85a0-b67464a58563 for instance with vm_state deleted and task_state None.
Nov 15 19:01:07 user nova-compute[75634]: DEBUG nova.compute.manager [req-df3f22dd-f26f-4393-b7a4-90010e5e6046 req-00a0c661-be8e-45ce-81e5-7abf2ffc8099 service nova] [instance: 8dc98ddc-cf74-4bf1-b6ce-37f82ae57b44] Received event network-vif-deleted-4e3260a7-c46e-48a2-85a0-b67464a58563 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:01:20 user nova-compute[75634]: INFO nova.compute.claims [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Claim successful on node user
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:01:20 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.policy [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89755cafe30b4013b0642283a83bab00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812d9a6afc424b4eb1e6d50d3035531a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:01:20 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Creating image(s)
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "/opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "/opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "/opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:20 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk 1073741824" returned: 0 in 0.054s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Successfully created port: dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Cannot resize image /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Ensure instance console log exists: /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Successfully updated port: dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquired lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-changed-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.compute.manager [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Refreshing instance network info cache due to event network-changed-dfa39cdc-b2de-4f51-85fd-bc50af46a7be. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] Acquiring lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:01:21 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.neutron [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating instance_info_cache with network_info: [{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Releasing lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Instance network_info: |[{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] Acquired lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Refreshing network info cache for port dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Start _get_guest_xml network_info=[{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:01:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:01:22 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850015501',display_name='tempest-AttachVolumeTestJSON-server-850015501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850015501',id=48,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFbhmbkB7xw5pOr3ECpsjh1HSFhGq7HAkiwFAFr4BK+q5zj8sTvg+Y6X7TNiyb46hN5dBsaOKOXq7+cY9OfmChDqVxi21NZQJcQ8PJI+m0Ap91G7rWJGy/8WhRRER2yBA==',key_name='tempest-keypair-847738670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-l4shi9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=a662ce10-e0cf-45ff-a365-15190a7b3078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.objects.instance [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'pci_devices' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:01:22 user nova-compute[75634]:   <uuid>a662ce10-e0cf-45ff-a365-15190a7b3078</uuid>
Nov 15 19:01:22 user nova-compute[75634]:   <name>instance-00000030</name>
Nov 15 19:01:22 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:01:22 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:01:22 user nova-compute[75634]:   <metadata>
Nov 15 19:01:22 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:01:22 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:name>tempest-AttachVolumeTestJSON-server-850015501</nova:name>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:01:22</nova:creationTime>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:01:22 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:01:22 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:owner>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:user uuid="89755cafe30b4013b0642283a83bab00">tempest-AttachVolumeTestJSON-915928723-project-member</nova:user>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:project uuid="812d9a6afc424b4eb1e6d50d3035531a">tempest-AttachVolumeTestJSON-915928723</nova:project>
Nov 15 19:01:22 user nova-compute[75634]:       </nova:owner>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:01:22 user nova-compute[75634]:       <nova:ports>
Nov 15 19:01:22 user nova-compute[75634]:         <nova:port uuid="dfa39cdc-b2de-4f51-85fd-bc50af46a7be">
Nov 15 19:01:22 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 19:01:22 user nova-compute[75634]:         </nova:port>
Nov 15 19:01:22 user nova-compute[75634]:       </nova:ports>
Nov 15 19:01:22 user nova-compute[75634]:     </nova:instance>
Nov 15 19:01:22 user nova-compute[75634]:   </metadata>
Nov 15 19:01:22 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:01:22 user nova-compute[75634]:     <system>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="serial">a662ce10-e0cf-45ff-a365-15190a7b3078</entry>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="uuid">a662ce10-e0cf-45ff-a365-15190a7b3078</entry>
Nov 15 19:01:22 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:01:22 user nova-compute[75634]:     </system>
Nov 15 19:01:22 user nova-compute[75634]:   </sysinfo>
Nov 15 19:01:22 user nova-compute[75634]:   <os>
Nov 15 19:01:22 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:01:22 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:01:22 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:01:22 user nova-compute[75634]:   </os>
Nov 15 19:01:22 user nova-compute[75634]:   <features>
Nov 15 19:01:22 user nova-compute[75634]:     <acpi/>
Nov 15 19:01:22 user nova-compute[75634]:     <apic/>
Nov 15 19:01:22 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:01:22 user nova-compute[75634]:   </features>
Nov 15 19:01:22 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:01:22 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:01:22 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:01:22 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:01:22 user nova-compute[75634]:   </clock>
Nov 15 19:01:22 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:01:22 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:01:22 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:01:22 user nova-compute[75634]:   </cpu>
Nov 15 19:01:22 user nova-compute[75634]:   <devices>
Nov 15 19:01:22 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:01:22 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:01:22 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk"/>
Nov 15 19:01:22 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:01:22 user nova-compute[75634]:     </disk>
Nov 15 19:01:22 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:01:22 user nova-compute[75634]:       <mac address="fa:16:3e:34:9b:ea"/>
Nov 15 19:01:22 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:01:22 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:01:22 user nova-compute[75634]:       <target dev="tapdfa39cdc-b2"/>
Nov 15 19:01:22 user nova-compute[75634]:     </interface>
Nov 15 19:01:22 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:01:22 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/console.log" append="off"/>
Nov 15 19:01:22 user nova-compute[75634]:     </serial>
Nov 15 19:01:22 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:01:22 user nova-compute[75634]:     <video>
Nov 15 19:01:22 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:01:22 user nova-compute[75634]:     </video>
Nov 15 19:01:22 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:01:22 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:01:22 user nova-compute[75634]:     </rng>
Nov 15 19:01:22 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:01:22 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:01:22 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:01:22 user nova-compute[75634]:     </memballoon>
Nov 15 19:01:22 user nova-compute[75634]:   </devices>
Nov 15 19:01:22 user nova-compute[75634]: </domain>
Nov 15 19:01:22 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850015501',display_name='tempest-AttachVolumeTestJSON-server-850015501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850015501',id=48,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFbhmbkB7xw5pOr3ECpsjh1HSFhGq7HAkiwFAFr4BK+q5zj8sTvg+Y6X7TNiyb46hN5dBsaOKOXq7+cY9OfmChDqVxi21NZQJcQ8PJI+m0Ap91G7rWJGy/8WhRRER2yBA==',key_name='tempest-keypair-847738670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-l4shi9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=a662ce10-e0cf-45ff-a365-15190a7b3078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG os_vif [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '426549c0-dfe9-5a3b-af61-e973c3e0f0de', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa39cdc-b2, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfa39cdc-b2, col_values=(('qos', UUID('e3c509c9-bc44-4291-9941-e8ab9eb18af7')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfa39cdc-b2, col_values=(('external_ids', {'iface-id': 'dfa39cdc-b2de-4f51-85fd-bc50af46a7be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:9b:ea', 'vm-uuid': 'a662ce10-e0cf-45ff-a365-15190a7b3078'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:22 user nova-compute[75634]: INFO os_vif [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2')
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No VIF found with MAC fa:16:3e:34:9b:ea, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updated VIF entry in instance network info cache for port dfa39cdc-b2de-4f51-85fd-bc50af46a7be. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG nova.network.neutron [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating instance_info_cache with network_info: [{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:22 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-cf3a7c46-c475-47aa-9df6-6e5f433ff393 req-9c5a6f0e-fc47-464e-86fb-7ed022404fc6 service nova] Releasing lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:23 user nova-compute[75634]: DEBUG nova.compute.manager [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] No waiting events found dispatching network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:23 user nova-compute[75634]: WARNING nova.compute.manager [req-a946b60c-18f9-4fb9-897b-1d4d41f2df2d req-dfbeb579-5cb0-4ef2-9821-805b2a3d29b4 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received unexpected event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be for instance with vm_state building and task_state spawning.
Nov 15 19:01:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:25 user nova-compute[75634]: INFO nova.compute.manager [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Terminating instance
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:01:25 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Instance spawned successfully.
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:01:25 user nova-compute[75634]: INFO nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] No waiting events found dispatching network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:25 user nova-compute[75634]: WARNING nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received unexpected event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be for instance with vm_state building and task_state spawning.
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:25 user nova-compute[75634]: DEBUG nova.compute.manager [req-c9114117-e80e-4428-8b8d-39052666e424 req-4bc06cb9-8abe-4952-8791-6d60ad1b0338 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:01:25 user nova-compute[75634]: INFO nova.compute.manager [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Took 5.76 seconds to build instance.
Nov 15 19:01:25 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-2af33b13-ac96-4f86-9510-549e9935e09e tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.009s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Instance destroyed successfully.
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.objects.instance [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lazy-loading 'resources' on Instance uuid 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-574738749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-574738749',id=18,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:41:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17eb80780ad4231889417dab82ea2cf',ramdisk_id='',reservation_id='r-hzvbiw71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:43:45Z,user_data=None,user_id='000d54e8a82d48b58f554ae085a4dab0',uuid=5f73c5a4-1de9-4239-bcb8-2bb91bf42fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converting VIF {"id": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "address": "fa:16:3e:54:a3:75", "network": {"id": "92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1377309672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17eb80780ad4231889417dab82ea2cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6e3c9a-ea", "ovs_interfaceid": "8a6e3c9a-ea2d-49a7-977e-354e6b9817d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG os_vif [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a6e3c9a-ea, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3a78a10-e865-4c4d-a78c-78046af57fcf) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: INFO os_vif [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:75,bridge_name='br-int',has_traffic_filtering=True,id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5,network=Network(92e34e89-6fc6-4c3c-bc0c-b739cf35cc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6e3c9a-ea')
Nov 15 19:01:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Deleting instance files /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff_del
Nov 15 19:01:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Deletion of /opt/stack/data/nova/instances/5f73c5a4-1de9-4239-bcb8-2bb91bf42fff_del complete
Nov 15 19:01:26 user nova-compute[75634]: INFO nova.compute.manager [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 19:01:26 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:27 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Took 0.82 seconds to deallocate network for instance.
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-28aba997-e745-4d8b-8059-e84f2ee29801 req-1e800f83-e345-41ec-9f8b-c89733b6f604 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-deleted-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: INFO nova.compute.manager [req-28aba997-e745-4d8b-8059-e84f2ee29801 req-1e800f83-e345-41ec-9f8b-c89733b6f604 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Neutron deleted interface 8a6e3c9a-ea2d-49a7-977e-354e6b9817d5; detaching it from the instance and deleting it from the info cache
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.network.neutron [req-28aba997-e745-4d8b-8059-e84f2ee29801 req-1e800f83-e345-41ec-9f8b-c89733b6f604 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-28aba997-e745-4d8b-8059-e84f2ee29801 req-1e800f83-e345-41ec-9f8b-c89733b6f604 service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Detach interface failed, port_id=8a6e3c9a-ea2d-49a7-977e-354e6b9817d5, reason: Instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Deleted allocations for instance 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-574a4870-a446-406d-886e-c65bf6cec25e tempest-ServerBootFromVolumeStableRescueTest-1503063619 tempest-ServerBootFromVolumeStableRescueTest-1503063619-project-member] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:27 user nova-compute[75634]: WARNING nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state deleted and task_state None.
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:27 user nova-compute[75634]: WARNING nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state deleted and task_state None.
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:27 user nova-compute[75634]: WARNING nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state deleted and task_state None.
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:27 user nova-compute[75634]: WARNING nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-unplugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state deleted and task_state None.
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Acquiring lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] Lock "5f73c5a4-1de9-4239-bcb8-2bb91bf42fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] No waiting events found dispatching network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:27 user nova-compute[75634]: WARNING nova.compute.manager [req-62d52e5d-f3d3-486e-a3bf-3993907152af req-d021f423-1205-47a2-baa5-26b6cc389b9d service nova] [instance: 5f73c5a4-1de9-4239-bcb8-2bb91bf42fff] Received unexpected event network-vif-plugged-8a6e3c9a-ea2d-49a7-977e-354e6b9817d5 for instance with vm_state deleted and task_state None.
Nov 15 19:01:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-changed-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing instance network info cache due to event network-changed-c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:01:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] Acquiring lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:01:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] Acquired lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:01:34 user nova-compute[75634]: DEBUG nova.network.neutron [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Refreshing network info cache for port c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:35 user nova-compute[75634]: INFO nova.compute.manager [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Terminating instance
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.compute.manager [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updated VIF entry in instance network info cache for port c69eede0-9686-476b-9f6b-80c77112028a. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.network.neutron [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating instance_info_cache with network_info: [{"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-68850fc6-53e8-449d-91cf-06700b77c277 req-072d3f46-c7ee-409f-bc31-c6e8f92d9390 service nova] Releasing lock "refresh_cache-db6e015d-0328-4524-8f25-79ef5f54ef40" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:01:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Instance destroyed successfully.
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lazy-loading 'resources' on Instance uuid db6e015d-0328-4524-8f25-79ef5f54ef40 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414785433',display_name='tempest-TestVolumeBootPattern-server-1414785433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414785433',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpXSRjZKr+3gC9lvf6Nx75CZk+J+Nt6Yj9n+1IjhM3SiyZirEtKPjEIJBdLRVV2oXDgPIAFYxLO2k70L9yKWCnZgyfntUINypIhh2lQ3W55YwG08txc7KAhzTIOiIaxSQ==',key_name='tempest-TestVolumeBootPattern-696830635',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfcc977f8a14a7c8d13d1eed1061b0f',ramdisk_id='',reservation_id='r-jkuhdhp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-34940949',owner_user_name='tempest-TestVolumeBootPattern-34940949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:56:59Z,user_data=None,user_id='2e4cce3e6acd4e279a8e1746f980987b',uuid=db6e015d-0328-4524-8f25-79ef5f54ef40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converting VIF {"id": "c69eede0-9686-476b-9f6b-80c77112028a", "address": "fa:16:3e:0d:f1:c5", "network": {"id": "f48480b4-b281-448b-8ba7-4d623275a9d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-150313117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfcc977f8a14a7c8d13d1eed1061b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69eede0-96", "ovs_interfaceid": "c69eede0-9686-476b-9f6b-80c77112028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_vif [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69eede0-96, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e03b0fe8-7eec-42fe-b4b6-1ff1da57038b) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:35 user nova-compute[75634]: INFO os_vif [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:c5,bridge_name='br-int',has_traffic_filtering=True,id=c69eede0-9686-476b-9f6b-80c77112028a,network=Network(f48480b4-b281-448b-8ba7-4d623275a9d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69eede0-96')
Nov 15 19:01:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQNPtenv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:01:35 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2ef0b-9d85-4324-b744-0d34c0e9d0a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:01:35 user nova-compute[75634]: No targets found.
Nov 15 19:01:35 user nova-compute[75634]: iSNS:
Nov 15 19:01:35 user nova-compute[75634]: No targets found.
Nov 15 19:01:35 user nova-compute[75634]: STATIC:
Nov 15 19:01:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092
Nov 15 19:01:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:01:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:01:35 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:01:35 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:01:35 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:01:35 user nova-compute[75634]: FIRMWARE:
Nov 15 19:01:35 user nova-compute[75634]: No targets found.
Nov 15 19:01:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:01:35 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:01:35 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd25672-14d6-47d3-92e2-b79255bfaf7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa66f64-0406-4065-962c-d317788455b1]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:01:35 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:01:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 (non-flash)
Nov 15 19:01:35 user nova-compute[75634]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:01:35 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4458a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092'): ({'sde'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Removing single pathed devices sde {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c7f0a2-4d84-4c9f-90cf-62077108f05c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d541e75-f8cc-4fc9-8249-3b01c9c7ac09]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Flushing IO for device /dev/sde {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bed6b9-f167-4612-8919-6e0c684877a5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:01:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bba3f67-cc38-4ef7-92d4-4def5b221c0d]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] SCSI volumes sde have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c73223-0e94-48de-ad53-38baabe650b1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d587fa2e-5f96-4fff-9337-d884c9e6db3f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260]
Nov 15 19:01:36 user nova-compute[75634]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092, portal: 172.16.0.220,3260] successful.
Nov 15 19:01:36 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dca3e22-a600-43ab-b92f-48c0e821d092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9eac0e-f9a5-4569-93e0-0c19f32f8f0d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] <== disconnect_volume: return (334ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:01:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Deleting instance files /opt/stack/data/nova/instances/db6e015d-0328-4524-8f25-79ef5f54ef40_del
Nov 15 19:01:36 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Deletion of /opt/stack/data/nova/instances/db6e015d-0328-4524-8f25-79ef5f54ef40_del complete
Nov 15 19:01:36 user nova-compute[75634]: INFO nova.compute.manager [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:36 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:36 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Took 0.44 seconds to deallocate network for instance.
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-unplugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] No waiting events found dispatching network-vif-unplugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-unplugged-c69eede0-9686-476b-9f6b-80c77112028a for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Acquiring lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] No waiting events found dispatching network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:37 user nova-compute[75634]: WARNING nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received unexpected event network-vif-plugged-c69eede0-9686-476b-9f6b-80c77112028a for instance with vm_state active and task_state deleting.
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-46892a9d-0f19-435f-9d59-a38431a40510 req-cb39b7b3-5181-4671-9bf6-04f0a6dea890 service nova] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Received event network-vif-deleted-c69eede0-9686-476b-9f6b-80c77112028a {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:37 user nova-compute[75634]: INFO nova.compute.manager [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] [instance: db6e015d-0328-4524-8f25-79ef5f54ef40] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:37 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Deleted allocations for instance db6e015d-0328-4524-8f25-79ef5f54ef40
Nov 15 19:01:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-1c8f8351-c0fb-4724-8a1a-db4eb1a0d0b2 tempest-TestVolumeBootPattern-34940949 tempest-TestVolumeBootPattern-34940949-project-member] Lock "db6e015d-0328-4524-8f25-79ef5f54ef40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:38 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:01:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:01:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:01:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8401MB free_disk=24.943347930908203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a662ce10-e0cf-45ff-a365-15190a7b3078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:01:44 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [{"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-dbc304fa-0f5f-44b9-9dca-8f39d59a157e" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:01:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:01:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:01:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:01:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:55 user nova-compute[75634]: INFO nova.compute.manager [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Terminating instance
Nov 15 19:01:55 user nova-compute[75634]: DEBUG nova.compute.manager [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG nova.compute.manager [req-e35801b6-4e37-479d-9c1d-b02d0619f951 req-ad6ca4b2-2b93-4d05-afbf-e9fb9d8e5749 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-unplugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:01:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Instance destroyed successfully.
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.objects.instance [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lazy-loading 'resources' on Instance uuid dbc304fa-0f5f-44b9-9dca-8f39d59a157e {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099763569',display_name='tempest-ServerRescueNegativeTestJSON-server-1099763569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099763569',id=26,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfe1f0276a74611b6cf863fa909aa61',ramdisk_id='',reservation_id='r-s2hga7f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1650146848',owner_user_name='tempest-ServerRescueNegativeTestJSON-1650146848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T18:51:44Z,user_data=None,user_id='395915213ac442edbdd3d80e03367744',uuid=dbc304fa-0f5f-44b9-9dca-8f39d59a157e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converting VIF {"id": "07777476-904a-462a-b52f-17f75c58f2ff", "address": "fa:16:3e:70:08:ff", "network": {"id": "c07b5636-a753-40ba-b92f-1e83d898d915", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-469113243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dfe1f0276a74611b6cf863fa909aa61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07777476-90", "ovs_interfaceid": "07777476-904a-462a-b52f-17f75c58f2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG os_vif [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07777476-90, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae1a6479-89dc-4197-a65c-a8c25351cf0f) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: INFO os_vif [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:08:ff,bridge_name='br-int',has_traffic_filtering=True,id=07777476-904a-462a-b52f-17f75c58f2ff,network=Network(c07b5636-a753-40ba-b92f-1e83d898d915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07777476-90')
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Deleting instance files /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e_del
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Deletion of /opt/stack/data/nova/instances/dbc304fa-0f5f-44b9-9dca-8f39d59a157e_del complete
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.compute.manager [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 15 19:01:56 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Took 0.42 seconds to deallocate network for instance.
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6641854-a51e-4048-9a5e-1258e38dae2d req-61c8b87b-2a7c-481e-9592-485fae5bf9a2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-deleted-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.compute.manager [req-d6641854-a51e-4048-9a5e-1258e38dae2d req-61c8b87b-2a7c-481e-9592-485fae5bf9a2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Neutron deleted interface 07777476-904a-462a-b52f-17f75c58f2ff; detaching it from the instance and deleting it from the info cache
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.network.neutron [req-d6641854-a51e-4048-9a5e-1258e38dae2d req-61c8b87b-2a7c-481e-9592-485fae5bf9a2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.compute.manager [req-d6641854-a51e-4048-9a5e-1258e38dae2d req-61c8b87b-2a7c-481e-9592-485fae5bf9a2 service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Detach interface failed, port_id=07777476-904a-462a-b52f-17f75c58f2ff, reason: Instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:56 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Deleted allocations for instance dbc304fa-0f5f-44b9-9dca-8f39d59a157e
Nov 15 19:01:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:01:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86f6ed1c-fa89-44d7-a2ed-ce9f503262a5 tempest-ServerRescueNegativeTestJSON-1650146848 tempest-ServerRescueNegativeTestJSON-1650146848-project-member] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.370s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:01:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] Acquiring lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:01:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:01:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] Lock "dbc304fa-0f5f-44b9-9dca-8f39d59a157e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:01:57 user nova-compute[75634]: DEBUG nova.compute.manager [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] No waiting events found dispatching network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:01:57 user nova-compute[75634]: WARNING nova.compute.manager [req-a050feaf-74fc-498e-bd3c-7f87e6a8aff3 req-fa91ded6-d221-43bf-9822-ee2a60f31fae service nova] [instance: dbc304fa-0f5f-44b9-9dca-8f39d59a157e] Received unexpected event network-vif-plugged-07777476-904a-462a-b52f-17f75c58f2ff for instance with vm_state deleted and task_state None.
Nov 15 19:02:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:14 user nova-compute[75634]: INFO nova.compute.manager [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Unrescuing
Nov 15 19:02:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG nova.network.neutron [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'flavor' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG nova.compute.manager [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:15 user nova-compute[75634]: WARNING nova.compute.manager [req-c2939c6a-6d99-4bf7-9edd-5ffe09eeb4ea req-8516c4b3-865a-402e-bcf2-cdf8665479c0 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance destroyed successfully.
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:17 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing instance network info cache due to event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated VIF entry in instance network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing instance network info cache due to event network-changed-4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Refreshing network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [None req-d7e6384d-7c99-4e9e-9d74-32d5557426d9 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated VIF entry in instance network info cache for port 4cf8faf0-cb34-443e-b98c-0ea6048aeef7. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:18 user nova-compute[75634]: WARNING nova.compute.manager [req-2982f6d2-82a1-41f2-8c17-a68f04f16881 req-c10aeb2a-71a2-440a-8067-939c70b6742f service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state rescued and task_state unrescuing.
Nov 15 19:02:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:02:33 user nova-compute[75634]: INFO nova.compute.claims [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Claim successful on node user
Nov 15 19:02:33 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:33 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:02:34 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:02:34 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Creating image(s)
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "/opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "/opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.policy [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65f505cdcf1a4d85919968e505aa7176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdccc654388c4d56bf31547347cd6878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk 1073741824" returned: 0 in 0.058s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Cannot resize image /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Ensure instance console log exists: /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Successfully created port: 3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Successfully updated port: 3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquired lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-changed-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG nova.compute.manager [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Refreshing instance network info cache due to event network-changed-3ec60fef-b312-4f27-8230-88a095d92864. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:02:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] Acquiring lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Updating instance_info_cache with network_info: [{"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Releasing lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Instance network_info: |[{"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] Acquired lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Refreshing network info cache for port 3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Start _get_guest_xml network_info=[{"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:02:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:36 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083153962',display_name='tempest-VolumesActionsTest-instance-1083153962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083153962',id=49,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdccc654388c4d56bf31547347cd6878',ramdisk_id='',reservation_id='r-sskxqutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429249022',owner_user_name='tempest-VolumesActionsTest-429249022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:02:34Z,user_data=None,user_id='65f505cdcf1a4d85919968e505aa7176',uuid=4c81fdc4-e0b0-4d29-886b-8a8340ce40e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converting VIF {"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:02:36 user nova-compute[75634]:   <uuid>4c81fdc4-e0b0-4d29-886b-8a8340ce40e4</uuid>
Nov 15 19:02:36 user nova-compute[75634]:   <name>instance-00000031</name>
Nov 15 19:02:36 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:02:36 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:02:36 user nova-compute[75634]:   <metadata>
Nov 15 19:02:36 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:02:36 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:name>tempest-VolumesActionsTest-instance-1083153962</nova:name>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:02:36</nova:creationTime>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:02:36 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:02:36 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:owner>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:user uuid="65f505cdcf1a4d85919968e505aa7176">tempest-VolumesActionsTest-429249022-project-member</nova:user>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:project uuid="bdccc654388c4d56bf31547347cd6878">tempest-VolumesActionsTest-429249022</nova:project>
Nov 15 19:02:36 user nova-compute[75634]:       </nova:owner>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:02:36 user nova-compute[75634]:       <nova:ports>
Nov 15 19:02:36 user nova-compute[75634]:         <nova:port uuid="3ec60fef-b312-4f27-8230-88a095d92864">
Nov 15 19:02:36 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 19:02:36 user nova-compute[75634]:         </nova:port>
Nov 15 19:02:36 user nova-compute[75634]:       </nova:ports>
Nov 15 19:02:36 user nova-compute[75634]:     </nova:instance>
Nov 15 19:02:36 user nova-compute[75634]:   </metadata>
Nov 15 19:02:36 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:02:36 user nova-compute[75634]:     <system>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="serial">4c81fdc4-e0b0-4d29-886b-8a8340ce40e4</entry>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="uuid">4c81fdc4-e0b0-4d29-886b-8a8340ce40e4</entry>
Nov 15 19:02:36 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:02:36 user nova-compute[75634]:     </system>
Nov 15 19:02:36 user nova-compute[75634]:   </sysinfo>
Nov 15 19:02:36 user nova-compute[75634]:   <os>
Nov 15 19:02:36 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:02:36 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:02:36 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:02:36 user nova-compute[75634]:   </os>
Nov 15 19:02:36 user nova-compute[75634]:   <features>
Nov 15 19:02:36 user nova-compute[75634]:     <acpi/>
Nov 15 19:02:36 user nova-compute[75634]:     <apic/>
Nov 15 19:02:36 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:02:36 user nova-compute[75634]:   </features>
Nov 15 19:02:36 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:02:36 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:02:36 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:02:36 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:02:36 user nova-compute[75634]:   </clock>
Nov 15 19:02:36 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:02:36 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:02:36 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:02:36 user nova-compute[75634]:   </cpu>
Nov 15 19:02:36 user nova-compute[75634]:   <devices>
Nov 15 19:02:36 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:02:36 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:02:36 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk"/>
Nov 15 19:02:36 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:02:36 user nova-compute[75634]:     </disk>
Nov 15 19:02:36 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:02:36 user nova-compute[75634]:       <mac address="fa:16:3e:f3:89:03"/>
Nov 15 19:02:36 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:02:36 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:02:36 user nova-compute[75634]:       <target dev="tap3ec60fef-b3"/>
Nov 15 19:02:36 user nova-compute[75634]:     </interface>
Nov 15 19:02:36 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:02:36 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/console.log" append="off"/>
Nov 15 19:02:36 user nova-compute[75634]:     </serial>
Nov 15 19:02:36 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:02:36 user nova-compute[75634]:     <video>
Nov 15 19:02:36 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:02:36 user nova-compute[75634]:     </video>
Nov 15 19:02:36 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:02:36 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:02:36 user nova-compute[75634]:     </rng>
Nov 15 19:02:36 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:02:36 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:02:36 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:02:36 user nova-compute[75634]:     </memballoon>
Nov 15 19:02:36 user nova-compute[75634]:   </devices>
Nov 15 19:02:36 user nova-compute[75634]: </domain>
Nov 15 19:02:36 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083153962',display_name='tempest-VolumesActionsTest-instance-1083153962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083153962',id=49,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdccc654388c4d56bf31547347cd6878',ramdisk_id='',reservation_id='r-sskxqutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429249022',owner_user_name='tempest-VolumesActionsTest-429249022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:02:34Z,user_data=None,user_id='65f505cdcf1a4d85919968e505aa7176',uuid=4c81fdc4-e0b0-4d29-886b-8a8340ce40e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converting VIF {"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG os_vif [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429262d8-ef23-5fd8-9af2-a0c7e0cd06f5', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ec60fef-b3, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ec60fef-b3, col_values=(('qos', UUID('61f0fa44-b84f-4329-957e-ff31b79f829e')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ec60fef-b3, col_values=(('external_ids', {'iface-id': '3ec60fef-b312-4f27-8230-88a095d92864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:89:03', 'vm-uuid': '4c81fdc4-e0b0-4d29-886b-8a8340ce40e4'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:36 user nova-compute[75634]: INFO os_vif [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3')
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] No VIF found with MAC fa:16:3e:f3:89:03, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Updated VIF entry in instance network info cache for port 3ec60fef-b312-4f27-8230-88a095d92864. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG nova.network.neutron [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Updating instance_info_cache with network_info: [{"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0ce9f66f-84f2-415e-8307-299d30afc206 req-e70aa36c-f5d7-434a-89c2-ebd20a2f87a9 service nova] Releasing lock "refresh_cache-4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:37 user nova-compute[75634]: INFO nova.compute.manager [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Unshelving
Nov 15 19:02:37 user nova-compute[75634]: INFO nova.virt.block_device [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Booting with volume 65bcff69-6349-4196-9987-6dce55b5e708 at /dev/vda
Nov 15 19:02:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.utils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38c4a9-2fa5-46b7-9568-19ae3e32f198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3836c4-08a7-4e60-9825-175062018b92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1e08ad-4e1e-441b-b3c5-7ab5b9b0eea0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a984d8-6a2c-4894-87c4-f83fd3fb1b8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:02:37 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:02:37 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14cad9-87d1-4f26-bcc4-6469b539a26c]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG os_brick.utils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:02:37 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating existing volume attachment record: b579e38b-8a6d-4d47-a446-e2b7602152ff {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:02:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:38 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.compute.manager [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] No waiting events found dispatching network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:39 user nova-compute[75634]: WARNING nova.compute.manager [req-52478b2f-426f-4a7d-a598-e45c6be975ee req-da31444e-8d71-47e9-b908-c26fa3824d94 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received unexpected event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 for instance with vm_state building and task_state spawning.
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:02:39 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Instance spawned successfully.
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:02:39 user nova-compute[75634]: INFO nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 15 19:02:39 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:39 user nova-compute[75634]: INFO nova.compute.manager [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Took 6.26 seconds to build instance.
Nov 15 19:02:39 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5a564084-4ad7-4bb3-ad54-6dcb5ff7b6fa tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.378s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:40 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=24.93270492553711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a662ce10-e0cf-45ff-a365-15190a7b3078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.manager [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] No waiting events found dispatching network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:41 user nova-compute[75634]: WARNING nova.compute.manager [req-ab69d91a-45d2-4137-b59e-1353a9f49a95 req-a61391dd-dbec-4c0b-975c-14d0fd1c8a69 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received unexpected event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 for instance with vm_state active and task_state None.
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 19:02:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'pci_requests' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'numa_topology' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:02:42 user nova-compute[75634]: INFO nova.compute.claims [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Claim successful on node user
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:02:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:42 user nova-compute[75634]: INFO nova.network.neutron [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating port b21652aa-9edb-45d7-951a-788920656c0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-changed-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.compute.manager [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing instance network info cache due to event network-changed-b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:02:43 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Creating image(s)
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Did not create local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Ensure instance console log exists: /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start _get_guest_xml network_info=[{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2ab1727-c3ab-4aad-801f-ce02290fc9dd', 'attached_at': '', 'detached_at': '', 'volume_id': '65bcff69-6349-4196-9987-6dce55b5e708', 'serial': '65bcff69-6349-4196-9987-6dce55b5e708'}, 'guest_format': None, 'boot_index': 0, 'attachment_id': 'b579e38b-8a6d-4d47-a446-e2b7602152ff', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.network.neutron [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing network info cache for port b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:02:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.objects.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Object Instance<d2ab1727-c3ab-4aad-801f-ce02290fc9dd> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:02:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:02:43 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:02:43 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4258e4c-1645-47d3-8c11-f65a25c87736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:02:43 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[142df5b3-5a78-4647-89a3-c45906c900eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708] added
Nov 15 19:02:43 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a63c81-3ba9-413e-86b7-39203bbfede9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:43 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a40d2f-1176-4567-9125-5343ede626c9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcEHupPj {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcEHupPj" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecea1fe9-15bc-4e1e-87d5-63b7bedfc288]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcEHupPj'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2b402-c29c-448c-a9d2-bdd4f116ba01]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b8019-9f4f-4ba1-a817-762fc46c4718]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b01747-1911-496f-9c08-2f5f43def29b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]
Nov 15 19:02:44 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.
Nov 15 19:02:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b545457e-b17a-494c-a4a2-48354ff00403]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[085932d4-8737-409d-a110-8179c8f158f6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:02:44 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab1345-e016-4b3d-b68b-2ce1ef3cb067]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updated VIF entry in instance network info cache for port b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG nova.network.neutron [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f05d7f67-7d11-44cf-a750-8afc5227e368 req-da924b85-fb85-4983-9922-5bd6ee33b6a4 service nova] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:44 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23131646565636634', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131646565636634', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1296001899',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:02:38Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'pci_devices' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.objects.base [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Object Instance<d2ab1727-c3ab-4aad-801f-ce02290fc9dd> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75634) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:02:45 user nova-compute[75634]:   <uuid>d2ab1727-c3ab-4aad-801f-ce02290fc9dd</uuid>
Nov 15 19:02:45 user nova-compute[75634]:   <name>instance-0000002f</name>
Nov 15 19:02:45 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:02:45 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:02:45 user nova-compute[75634]:   <metadata>
Nov 15 19:02:45 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:02:45 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:02:45 user nova-compute[75634]:       <nova:name>tempest-TestShelveInstance-server-1126242064</nova:name>
Nov 15 19:02:45 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:02:43</nova:creationTime>
Nov 15 19:02:45 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:02:45 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:02:45 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:02:45 user nova-compute[75634]:       <nova:owner>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:user uuid="d7ffd656a0cc4f579c03d651715433d1">tempest-TestShelveInstance-437679720-project-member</nova:user>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:project uuid="13a864fca2b14cb7b073b3f8574ea9b8">tempest-TestShelveInstance-437679720</nova:project>
Nov 15 19:02:45 user nova-compute[75634]:       </nova:owner>
Nov 15 19:02:45 user nova-compute[75634]:       <nova:ports>
Nov 15 19:02:45 user nova-compute[75634]:         <nova:port uuid="b21652aa-9edb-45d7-951a-788920656c0f">
Nov 15 19:02:45 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 19:02:45 user nova-compute[75634]:         </nova:port>
Nov 15 19:02:45 user nova-compute[75634]:       </nova:ports>
Nov 15 19:02:45 user nova-compute[75634]:     </nova:instance>
Nov 15 19:02:45 user nova-compute[75634]:   </metadata>
Nov 15 19:02:45 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:02:45 user nova-compute[75634]:     <system>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="serial">d2ab1727-c3ab-4aad-801f-ce02290fc9dd</entry>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="uuid">d2ab1727-c3ab-4aad-801f-ce02290fc9dd</entry>
Nov 15 19:02:45 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:02:45 user nova-compute[75634]:     </system>
Nov 15 19:02:45 user nova-compute[75634]:   </sysinfo>
Nov 15 19:02:45 user nova-compute[75634]:   <os>
Nov 15 19:02:45 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:02:45 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:02:45 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:02:45 user nova-compute[75634]:   </os>
Nov 15 19:02:45 user nova-compute[75634]:   <features>
Nov 15 19:02:45 user nova-compute[75634]:     <acpi/>
Nov 15 19:02:45 user nova-compute[75634]:     <apic/>
Nov 15 19:02:45 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:02:45 user nova-compute[75634]:   </features>
Nov 15 19:02:45 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:02:45 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:02:45 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:02:45 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:02:45 user nova-compute[75634]:   </clock>
Nov 15 19:02:45 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:02:45 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:02:45 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:02:45 user nova-compute[75634]:   </cpu>
Nov 15 19:02:45 user nova-compute[75634]:   <devices>
Nov 15 19:02:45 user nova-compute[75634]:     <disk type="block" device="disk">
Nov 15 19:02:45 user nova-compute[75634]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:02:45 user nova-compute[75634]:       <source dev="/dev/sdb"/>
Nov 15 19:02:45 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:02:45 user nova-compute[75634]:       <serial>65bcff69-6349-4196-9987-6dce55b5e708</serial>
Nov 15 19:02:45 user nova-compute[75634]:     </disk>
Nov 15 19:02:45 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:02:45 user nova-compute[75634]:       <mac address="fa:16:3e:43:99:45"/>
Nov 15 19:02:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:02:45 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:02:45 user nova-compute[75634]:       <target dev="tapb21652aa-9e"/>
Nov 15 19:02:45 user nova-compute[75634]:     </interface>
Nov 15 19:02:45 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:02:45 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd/console.log" append="off"/>
Nov 15 19:02:45 user nova-compute[75634]:     </serial>
Nov 15 19:02:45 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:02:45 user nova-compute[75634]:     <video>
Nov 15 19:02:45 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:02:45 user nova-compute[75634]:     </video>
Nov 15 19:02:45 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:02:45 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:02:45 user nova-compute[75634]:     </rng>
Nov 15 19:02:45 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:02:45 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:02:45 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:02:45 user nova-compute[75634]:     </memballoon>
Nov 15 19:02:45 user nova-compute[75634]:   </devices>
Nov 15 19:02:45 user nova-compute[75634]: </domain>
Nov 15 19:02:45 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1296001899',keypairs=<?>,launch_index=0,launched_at=2023-11-15T18:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:02:38Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG os_vif [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea91966d-e24f-575b-ab12-db6c2e629d62', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb21652aa-9e, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb21652aa-9e, col_values=(('qos', UUID('296b69cb-429e-4c95-b658-7c209bfb7541')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb21652aa-9e, col_values=(('external_ids', {'iface-id': 'b21652aa-9edb-45d7-951a-788920656c0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:99:45', 'vm-uuid': 'd2ab1727-c3ab-4aad-801f-ce02290fc9dd'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:45 user nova-compute[75634]: INFO os_vif [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e')
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] No VIF found with MAC fa:16:3e:43:99:45, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [{"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ae61a358-95d3-4d6f-a127-fb2bacd88afa" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:02:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:46 user nova-compute[75634]: WARNING nova.compute.manager [req-7f592328-1cdd-41c7-8165-a5ce22fe388e req-d4ae3af6-021c-4353-be6d-61c27c34dad6 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 19:02:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:47 user nova-compute[75634]: INFO nova.compute.manager [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Detaching volume 2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:02:47 user nova-compute[75634]: INFO nova.virt.block_device [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Attempting to driver detach volume 2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 from mountpoint /dev/vdb
Nov 15 19:02:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Attempting to detach device vdb from instance ae61a358-95d3-4d6f-a127-fb2bacd88afa from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:02:47 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:02:47 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 19:02:47 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:02:47 user nova-compute[75634]:   <serial>2e1aad64-6d15-4d47-b42f-a10bc2fb75d5</serial>
Nov 15 19:02:47 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:02:47 user nova-compute[75634]: </disk>
Nov 15 19:02:47 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:02:47 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Successfully detached device vdb from instance ae61a358-95d3-4d6f-a127-fb2bacd88afa from the persistent domain config.
Nov 15 19:02:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae61a358-95d3-4d6f-a127-fb2bacd88afa from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:02:47 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:02:47 user nova-compute[75634]:   <source dev="/dev/sdf"/>
Nov 15 19:02:47 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:02:47 user nova-compute[75634]:   <serial>2e1aad64-6d15-4d47-b42f-a10bc2fb75d5</serial>
Nov 15 19:02:47 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:02:47 user nova-compute[75634]: </disk>
Nov 15 19:02:47 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:02:47 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:02:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance spawned successfully.
Nov 15 19:02:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5e9165ee-89b9-4d4e-a3c0-d72add89f99d tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.327s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:02:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:02:48 user nova-compute[75634]: WARNING nova.compute.manager [req-ce6cffad-65fd-4385-856c-b8e4ef5d61c7 req-52a14092-ded0-47f7-9bb5-df0a8d83cd59 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state None.
Nov 15 19:02:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:02:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 19:02:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 19:02:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:02:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:07 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae61a358-95d3-4d6f-a127-fb2bacd88afa is timed out.
Nov 15 19:03:07 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Successfully detached device vdb from instance ae61a358-95d3-4d6f-a127-fb2bacd88afa from the live domain config.
Nov 15 19:03:07 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShXdyHMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:07 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315f0a0-10d9-417f-adeb-d48dfadc09e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:03:07 user nova-compute[75634]: No targets found.
Nov 15 19:03:07 user nova-compute[75634]: iSNS:
Nov 15 19:03:07 user nova-compute[75634]: No targets found.
Nov 15 19:03:07 user nova-compute[75634]: STATIC:
Nov 15 19:03:07 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:03:07 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:03:07 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:03:07 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5
Nov 15 19:03:07 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:03:07 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:03:07 user nova-compute[75634]: FIRMWARE:
Nov 15 19:03:07 user nova-compute[75634]: No targets found.
Nov 15 19:03:07 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:03:07 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:03:07 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108cde8-d617-42b1-8d4f-0755edc68a15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f99fc-456b-4fa0-8401-0c7b6e2c5b11]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:03:07 user nova-compute[75634]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:07 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 (non-flash)
Nov 15 19:03:07 user nova-compute[75634]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:07 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4435b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5'): ({'sdf'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Removing single pathed devices sdf {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec9ee8-18ea-4e44-aca7-2e58005e7e6a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:07 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e2215-93f0-4036-957c-fca205ee7195]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Flushing IO for device /dev/sdf {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba49912-b505-4a39-8cf1-f9b404d726f8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe9eae-0a68-473f-8770-38d014e46ea6]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] SCSI volumes sdf have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[72884602-41fe-4dd5-ae4a-7d8b80dfa63a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e996f823-44e1-4c8d-bea3-694760f743a2]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260]
Nov 15 19:03:08 user nova-compute[75634]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5, portal: 172.16.0.220,3260] successful.
Nov 15 19:03:08 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1aad64-6d15-4d47-b42f-a10bc2fb75d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab48898-362a-46a2-8890-2939f87d43c6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] <== disconnect_volume: return (297ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:03:08 user nova-compute[75634]: DEBUG nova.objects.instance [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'flavor' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96311d14-d942-44f1-bfe5-4a81d168c980 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-changed-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Refreshing instance network info cache due to event network-changed-dfa39cdc-b2de-4f51-85fd-bc50af46a7be. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] Acquiring lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] Acquired lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:03:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Refreshing network info cache for port dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:03:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updated VIF entry in instance network info cache for port dfa39cdc-b2de-4f51-85fd-bc50af46a7be. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:03:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating instance_info_cache with network_info: [{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:03:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-7e5f0127-138a-4301-ada3-2632d5835854 req-207b0d89-4d49-498c-aa97-66815b20da94 service nova] Releasing lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:03:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:12 user nova-compute[75634]: INFO nova.compute.manager [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attaching volume a93464fd-909e-4389-9fd5-9b7ce671272e to /dev/vdb
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.utils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[14807b57-d487-4562-92a2-b13baae54552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1990968-4c65-4c90-89cb-5c04a161d416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e7260-c43a-42f7-be12-7cb1f09fb304]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758d012-8615-44af-a620-ddf5cfc4ea43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:03:12 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:03:12 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b964d-3e17-4bde-99fb-3cc2f55c349f]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG os_brick.utils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:12 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating existing volume attachment record: 357af7c2-d66f-4821-b28d-3cf674ed2c54 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:03:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJfRpmQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:17 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:17 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:17 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f33d62e-f612-4627-8a11-5eb86617eed6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:03:17 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[74399f63-f584-43f8-b78a-a0b8dbd149ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e] added
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca916f17-99b6-4b2d-b438-a9bfe7f005d0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32f6d2-9220-4563-a20f-5d94548cbe12]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJfRpmQb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJfRpmQb" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b066b90-7e63-4932-9b16-59e94f9d42dc]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJfRpmQb'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ff19a-79b3-4245-9c6b-aec71e766f58]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4595e-32bb-4006-b449-772ffb3a5b8e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[da299a27-c76c-41e6-953a-64aeee133729]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260]
Nov 15 19:03:17 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260] successful.
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c260b7-66e9-4832-baf9-0a5f52c42c12]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[434cf341-ef47-4135-923a-a3991f39e065]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:17 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:17 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:17 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a3b7c-dec3-478a-9f32-e02d303acf95]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:03:17 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJfRpmQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:03:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26432393237636337', 'path': '/dev/sdc'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432393237636337', 'path': '/dev/sdc'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:03:18 user nova-compute[75634]: DEBUG nova.objects.instance [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:03:18 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:18 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 19:03:18 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:03:18 user nova-compute[75634]:   <serial>a93464fd-909e-4389-9fd5-9b7ce671272e</serial>
Nov 15 19:03:18 user nova-compute[75634]: </disk>
Nov 15 19:03:18 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:03:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:03:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:03:19 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No VIF found with MAC fa:16:3e:34:9b:ea, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:03:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-3bfa0d67-6d8f-453d-b715-3d93d884f6ae tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.675s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:20 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:21 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:21 user nova-compute[75634]: INFO nova.compute.manager [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attaching volume 2762536f-1c13-4dcc-b156-fecffbe25c2c to /dev/vdc
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.utils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a65e9f-459b-4f64-a57b-99e8387bf70b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[209040e7-54c5-4927-8661-c18c367f86a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e71ada-067b-402c-baac-1d99c8fefd62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15637c2f-3e04-4b53-884c-362b7a5d3424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:03:22 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:03:22 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6145fe-4e9b-407c-8489-f89d4313f9d9]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG os_brick.utils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:22 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating existing volume attachment record: d91e2aff-6c33-4b9b-b794-62106c4d61f7 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:03:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuRAhTPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:26 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:26 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:26 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea5fa53-d324-4868-a5ef-b610ab720db9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:03:26 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be08a204-30ad-4dc6-baa1-885a39abcebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c] added
Nov 15 19:03:26 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093f64e-0d12-4d50-b5e4-2dc8dc69953a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a6e272-27d1-430c-acd3-368bc1beed58]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuRAhTPp {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuRAhTPp" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c2f1a4-dcfa-4877-82eb-7741cce1b8fe]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IuRAhTPp'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[709bde1d-d7ca-4177-9e3a-1a718b1cd852]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ecc50b-8021-434a-9a9f-75bd261c936e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9316748a-ae92-4a28-8397-8daa6e223a7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260]
Nov 15 19:03:27 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260] successful.
Nov 15 19:03:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fecf392-806a-4d84-b0b3-aa28bb15ae79]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f393d-37f9-4a49-8d8a-5815687eb5d6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:03:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:27 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:03:27 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] HCTL ('35', '-', '-', 0) found on session 62 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5396f2-eac9-4f19-9832-9dd817b1882a]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:03:27 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuRAhTPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23763323063636335', 'path': '/dev/sdd'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763323063636335', 'path': '/dev/sdd'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:03:28 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:28 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 19:03:28 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 19:03:28 user nova-compute[75634]:   <serial>2762536f-1c13-4dcc-b156-fecffbe25c2c</serial>
Nov 15 19:03:28 user nova-compute[75634]: </disk>
Nov 15 19:03:28 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] No VIF found with MAC fa:16:3e:34:9b:ea, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:03:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3d935a8-66f3-412c-a514-d294e5f9de5d tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.813s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:30 user nova-compute[75634]: INFO nova.compute.manager [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Detaching volume a93464fd-909e-4389-9fd5-9b7ce671272e
Nov 15 19:03:30 user nova-compute[75634]: INFO nova.virt.block_device [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attempting to driver detach volume a93464fd-909e-4389-9fd5-9b7ce671272e from mountpoint /dev/vdb
Nov 15 19:03:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Attempting to detach device vdb from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:03:30 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:30 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 19:03:30 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:03:30 user nova-compute[75634]:   <serial>a93464fd-909e-4389-9fd5-9b7ce671272e</serial>
Nov 15 19:03:30 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:03:30 user nova-compute[75634]: </disk>
Nov 15 19:03:30 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:03:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdb from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the persistent domain config.
Nov 15 19:03:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:03:30 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:30 user nova-compute[75634]:   <source dev="/dev/sdc"/>
Nov 15 19:03:30 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:03:30 user nova-compute[75634]:   <serial>a93464fd-909e-4389-9fd5-9b7ce671272e</serial>
Nov 15 19:03:30 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:03:30 user nova-compute[75634]: </disk>
Nov 15 19:03:30 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:03:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:38 user nova-compute[75634]: INFO nova.compute.manager [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Terminating instance
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.compute.manager [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.compute.manager [req-bc70152e-0470-4b4c-ae09-4811db5b997d req-096385f5-4373-4e91-8413-14b539a228bd service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-unplugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Instance destroyed successfully.
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lazy-loading 'resources' on Instance uuid ae61a358-95d3-4d6f-a127-fb2bacd88afa {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T18:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-285015549',display_name='tempest-ServerStableDeviceRescueTest-server-285015549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-285015549',id=44,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZX9edWOakXvTWec1sJJQeU3ZnjwvYevllHIUyQIxaVB0yft859vc0IgXJtsX53aLJUn8u5Gd3WfUxNpLBYsBpVv7ljGGT42x1GsEsBqn/jyIqChF03q4brUFZNRUkbA==',key_name='tempest-keypair-458089163',keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3ecd8bd04f64bec81495973abc55d4c',ramdisk_id='',reservation_id='r-wmukpqpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1481719976',owner_user_name='tempest-ServerStableDeviceRescueTest-1481719976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bb03f0f7e14a35990cb0378b225f66',uuid=ae61a358-95d3-4d6f-a127-fb2bacd88afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converting VIF {"id": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "address": "fa:16:3e:9f:53:8f", "network": {"id": "0b2f0169-5a31-4b35-8304-e8dfe6a747e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252811822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ecd8bd04f64bec81495973abc55d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf8faf0-cb", "ovs_interfaceid": "4cf8faf0-cb34-443e-b98c-0ea6048aeef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG os_vif [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cf8faf0-cb, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d6fa378-00d8-40eb-aea2-50aaa8d55e0d) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:38 user nova-compute[75634]: INFO os_vif [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:53:8f,bridge_name='br-int',has_traffic_filtering=True,id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7,network=Network(0b2f0169-5a31-4b35-8304-e8dfe6a747e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf8faf0-cb')
Nov 15 19:03:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Deleting instance files /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa_del
Nov 15 19:03:38 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Deletion of /opt/stack/data/nova/instances/ae61a358-95d3-4d6f-a127-fb2bacd88afa_del complete
Nov 15 19:03:38 user nova-compute[75634]: INFO nova.compute.manager [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 19:03:38 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:03:38 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:03:39 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:03:40 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Took 1.09 seconds to deallocate network for instance.
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc288b99-6b61-453b-a429-db82aae83a14 req-524dbf76-0a28-4e38-9040-79c784ca5a1e service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-deleted-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:03:40 user nova-compute[75634]: INFO nova.compute.manager [req-cc288b99-6b61-453b-a429-db82aae83a14 req-524dbf76-0a28-4e38-9040-79c784ca5a1e service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Neutron deleted interface 4cf8faf0-cb34-443e-b98c-0ea6048aeef7; detaching it from the instance and deleting it from the info cache
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.network.neutron [req-cc288b99-6b61-453b-a429-db82aae83a14 req-524dbf76-0a28-4e38-9040-79c784ca5a1e service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-cc288b99-6b61-453b-a429-db82aae83a14 req-524dbf76-0a28-4e38-9040-79c784ca5a1e service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Detach interface failed, port_id=4cf8faf0-cb34-443e-b98c-0ea6048aeef7, reason: Instance ae61a358-95d3-4d6f-a127-fb2bacd88afa could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:03:40 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Deleted allocations for instance ae61a358-95d3-4d6f-a127-fb2bacd88afa
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b94c0821-5574-447c-8b15-1016361c52f4 tempest-ServerStableDeviceRescueTest-1481719976 tempest-ServerStableDeviceRescueTest-1481719976-project-member] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] Acquiring lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] Lock "ae61a358-95d3-4d6f-a127-fb2bacd88afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.compute.manager [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] No waiting events found dispatching network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:03:40 user nova-compute[75634]: WARNING nova.compute.manager [req-6199798d-2b48-4b75-ad2c-eff69d045e8d req-81003447-0100-44ea-aa8a-47421d43f327 service nova] [instance: ae61a358-95d3-4d6f-a127-fb2bacd88afa] Received unexpected event network-vif-plugged-4cf8faf0-cb34-443e-b98c-0ea6048aeef7 for instance with vm_state deleted and task_state None.
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:03:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:03:41 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:03:41 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=25.017921447753906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance a662ce10-e0cf-45ff-a365-15190a7b3078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:03:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:44 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating instance_info_cache with network_info: [{"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-a662ce10-e0cf-45ff-a365-15190a7b3078" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:03:45 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:03:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:03:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:03:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:03:50 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a662ce10-e0cf-45ff-a365-15190a7b3078 is timed out.
Nov 15 19:03:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdb from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the live domain config.
Nov 15 19:03:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJfRpmQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:03:50 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7aabf7-337a-4b9b-97fc-454347f7735a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:03:50 user nova-compute[75634]: No targets found.
Nov 15 19:03:50 user nova-compute[75634]: iSNS:
Nov 15 19:03:50 user nova-compute[75634]: No targets found.
Nov 15 19:03:50 user nova-compute[75634]: STATIC:
Nov 15 19:03:50 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:03:50 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:03:50 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:03:50 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c
Nov 15 19:03:50 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:03:50 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:03:50 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e
Nov 15 19:03:50 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:03:50 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:03:50 user nova-compute[75634]: FIRMWARE:
Nov 15 19:03:50 user nova-compute[75634]: No targets found.
Nov 15 19:03:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:03:50 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:03:50 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7712d3a-4244-4e8d-9b45-4dd5c700d734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406e0f6-c178-462b-a6a4-bd5007e1114d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:50 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:50 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:03:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:03:50 user nova-compute[75634]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e (non-flash)
Nov 15 19:03:50 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:03:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44311e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e'): ({'sdc'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Removing single pathed devices sdc {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[65892ed1-5af1-4f7e-a0f5-a43c9e331c5d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d3ee2-5935-451b-9137-4e2df660d739]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flushing IO for device /dev/sdc {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b5ca8c-e261-4f73-a371-fa1f6bef5dc4]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c5318b-ad1b-467a-8626-84bf1cbca4a2]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] SCSI volumes sdc have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f12f1-2115-41c4-bf91-1b2aba0d608f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5510eb7-29f7-42c1-a451-716c0a53411c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260]
Nov 15 19:03:50 user nova-compute[75634]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e, portal: 172.16.0.220,3260] successful.
Nov 15 19:03:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93464fd-909e-4389-9fd5-9b7ce671272e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d0284f-0f7b-418c-aad3-b03df5ea5498]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== disconnect_volume: return (298ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:03:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:03:51 user nova-compute[75634]: DEBUG nova.objects.instance [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:03:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-455531e0-14f0-4892-a55d-89cac7bf0a07 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.756s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:03:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:03:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:03:52 user nova-compute[75634]: INFO nova.compute.manager [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Detaching volume 2762536f-1c13-4dcc-b156-fecffbe25c2c
Nov 15 19:03:52 user nova-compute[75634]: INFO nova.virt.block_device [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Attempting to driver detach volume 2762536f-1c13-4dcc-b156-fecffbe25c2c from mountpoint /dev/vdc
Nov 15 19:03:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Attempting to detach device vdc from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:03:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:03:52 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:52 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 19:03:52 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 19:03:52 user nova-compute[75634]:   <serial>2762536f-1c13-4dcc-b156-fecffbe25c2c</serial>
Nov 15 19:03:52 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 19:03:52 user nova-compute[75634]: </disk>
Nov 15 19:03:52 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:03:52 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdc from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the persistent domain config.
Nov 15 19:03:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:03:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:03:52 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:03:52 user nova-compute[75634]:   <source dev="/dev/sdd"/>
Nov 15 19:03:52 user nova-compute[75634]:   <target dev="vdc" bus="virtio"/>
Nov 15 19:03:52 user nova-compute[75634]:   <serial>2762536f-1c13-4dcc-b156-fecffbe25c2c</serial>
Nov 15 19:03:52 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 19:03:52 user nova-compute[75634]: </disk>
Nov 15 19:03:52 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:03:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:03:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:03:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:02 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:04:08 user nova-compute[75634]: INFO nova.compute.claims [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Claim successful on node user
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:08 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:04:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:04:09 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Creating image(s)
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "/opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "/opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "/opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.policy [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be2a360f4c548f68b795fad9b53ec41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e774ccbcb74a4381ab9941f5f5fd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk 1073741824" returned: 0 in 0.049s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:09 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Successfully created port: a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Cannot resize image /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Ensure instance console log exists: /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Successfully updated port: a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquired lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-changed-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.compute.manager [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Refreshing instance network info cache due to event network-changed-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] Acquiring lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.neutron [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updating instance_info_cache with network_info: [{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Releasing lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Instance network_info: |[{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] Acquired lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.neutron [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Refreshing network info cache for port a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Start _get_guest_xml network_info=[{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:04:10 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:04:10 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-817290497',display_name='tempest-VolumesNegativeTest-instance-817290497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-817290497',id=50,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e774ccbcb74a4381ab9941f5f5fd16',ramdisk_id='',reservation_id='r-a7bxeo1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-994322683',owner_user_name='tempest-VolumesNegativeTest-994322683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:04:09Z,user_data=None,user_id='2be2a360f4c548f68b795fad9b53ec41',uuid=40b1e69f-cafe-495a-8b48-166e59d8f320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converting VIF {"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.objects.instance [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lazy-loading 'pci_devices' on Instance uuid 40b1e69f-cafe-495a-8b48-166e59d8f320 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:04:10 user nova-compute[75634]:   <uuid>40b1e69f-cafe-495a-8b48-166e59d8f320</uuid>
Nov 15 19:04:10 user nova-compute[75634]:   <name>instance-00000032</name>
Nov 15 19:04:10 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:04:10 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:04:10 user nova-compute[75634]:   <metadata>
Nov 15 19:04:10 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:04:10 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:name>tempest-VolumesNegativeTest-instance-817290497</nova:name>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:04:10</nova:creationTime>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:04:10 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:04:10 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:owner>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:user uuid="2be2a360f4c548f68b795fad9b53ec41">tempest-VolumesNegativeTest-994322683-project-member</nova:user>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:project uuid="b7e774ccbcb74a4381ab9941f5f5fd16">tempest-VolumesNegativeTest-994322683</nova:project>
Nov 15 19:04:10 user nova-compute[75634]:       </nova:owner>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:04:10 user nova-compute[75634]:       <nova:ports>
Nov 15 19:04:10 user nova-compute[75634]:         <nova:port uuid="a1ea4c8d-efed-4c20-b3e0-e6054ce6b030">
Nov 15 19:04:10 user nova-compute[75634]:           <nova:ip type="fixed" address="192.168.233.158" ipVersion="4"/>
Nov 15 19:04:10 user nova-compute[75634]:         </nova:port>
Nov 15 19:04:10 user nova-compute[75634]:       </nova:ports>
Nov 15 19:04:10 user nova-compute[75634]:     </nova:instance>
Nov 15 19:04:10 user nova-compute[75634]:   </metadata>
Nov 15 19:04:10 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:04:10 user nova-compute[75634]:     <system>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="serial">40b1e69f-cafe-495a-8b48-166e59d8f320</entry>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="uuid">40b1e69f-cafe-495a-8b48-166e59d8f320</entry>
Nov 15 19:04:10 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:04:10 user nova-compute[75634]:     </system>
Nov 15 19:04:10 user nova-compute[75634]:   </sysinfo>
Nov 15 19:04:10 user nova-compute[75634]:   <os>
Nov 15 19:04:10 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:04:10 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:04:10 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:04:10 user nova-compute[75634]:   </os>
Nov 15 19:04:10 user nova-compute[75634]:   <features>
Nov 15 19:04:10 user nova-compute[75634]:     <acpi/>
Nov 15 19:04:10 user nova-compute[75634]:     <apic/>
Nov 15 19:04:10 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:04:10 user nova-compute[75634]:   </features>
Nov 15 19:04:10 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:04:10 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:04:10 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:04:10 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:04:10 user nova-compute[75634]:   </clock>
Nov 15 19:04:10 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:04:10 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:04:10 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:04:10 user nova-compute[75634]:   </cpu>
Nov 15 19:04:10 user nova-compute[75634]:   <devices>
Nov 15 19:04:10 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:04:10 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:04:10 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk"/>
Nov 15 19:04:10 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:04:10 user nova-compute[75634]:     </disk>
Nov 15 19:04:10 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:04:10 user nova-compute[75634]:       <mac address="fa:16:3e:bf:15:54"/>
Nov 15 19:04:10 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:04:10 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:04:10 user nova-compute[75634]:       <target dev="tapa1ea4c8d-ef"/>
Nov 15 19:04:10 user nova-compute[75634]:     </interface>
Nov 15 19:04:10 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:04:10 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/console.log" append="off"/>
Nov 15 19:04:10 user nova-compute[75634]:     </serial>
Nov 15 19:04:10 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:04:10 user nova-compute[75634]:     <video>
Nov 15 19:04:10 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:04:10 user nova-compute[75634]:     </video>
Nov 15 19:04:10 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:04:10 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:04:10 user nova-compute[75634]:     </rng>
Nov 15 19:04:10 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:04:10 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:04:10 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:04:10 user nova-compute[75634]:     </memballoon>
Nov 15 19:04:10 user nova-compute[75634]:   </devices>
Nov 15 19:04:10 user nova-compute[75634]: </domain>
Nov 15 19:04:10 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-817290497',display_name='tempest-VolumesNegativeTest-instance-817290497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-817290497',id=50,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e774ccbcb74a4381ab9941f5f5fd16',ramdisk_id='',reservation_id='r-a7bxeo1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-994322683',owner_user_name='tempest-VolumesNegativeTest-994322683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:04:09Z,user_data=None,user_id='2be2a360f4c548f68b795fad9b53ec41',uuid=40b1e69f-cafe-495a-8b48-166e59d8f320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converting VIF {"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG os_vif [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '245b498f-631b-50fb-bfdc-5f45ef882ca3', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1ea4c8d-ef, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1ea4c8d-ef, col_values=(('qos', UUID('d5aaa76d-bc1d-4690-9f43-9e16e4bd0a34')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1ea4c8d-ef, col_values=(('external_ids', {'iface-id': 'a1ea4c8d-efed-4c20-b3e0-e6054ce6b030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:15:54', 'vm-uuid': '40b1e69f-cafe-495a-8b48-166e59d8f320'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:11 user nova-compute[75634]: INFO os_vif [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef')
Nov 15 19:04:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] No VIF found with MAC fa:16:3e:bf:15:54, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updated VIF entry in instance network info cache for port a1ea4c8d-efed-4c20-b3e0-e6054ce6b030. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG nova.network.neutron [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updating instance_info_cache with network_info: [{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:11 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e3db9940-51b8-41d0-9aa1-a3ab69796ea1 req-c925577c-05a1-4b12-8467-45a84f3d97ba service nova] Releasing lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG nova.compute.manager [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] No waiting events found dispatching network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:12 user nova-compute[75634]: WARNING nova.compute.manager [req-4c8bb1c3-3c94-4c04-b021-6cc9843b8d4a req-162d86fd-76b8-46c7-898c-64caf389b78f service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received unexpected event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 for instance with vm_state building and task_state spawning.
Nov 15 19:04:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:13 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a662ce10-e0cf-45ff-a365-15190a7b3078 is timed out.
Nov 15 19:04:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully detached device vdc from instance a662ce10-e0cf-45ff-a365-15190a7b3078 from the live domain config.
Nov 15 19:04:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuRAhTPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:04:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4fb1c0-7833-4d53-a573-23784263c818]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:04:13 user nova-compute[75634]: No targets found.
Nov 15 19:04:13 user nova-compute[75634]: iSNS:
Nov 15 19:04:13 user nova-compute[75634]: No targets found.
Nov 15 19:04:13 user nova-compute[75634]: STATIC:
Nov 15 19:04:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:04:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:04:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:04:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c
Nov 15 19:04:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:04:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:04:13 user nova-compute[75634]: FIRMWARE:
Nov 15 19:04:13 user nova-compute[75634]: No targets found.
Nov 15 19:04:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:04:13 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:04:13 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab675b-af90-4cdd-a26b-3eb51a92042a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79a489-a21e-4418-982e-f753eb5cba8d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:04:13 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:04:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:04:13 user nova-compute[75634]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c (non-flash)
Nov 15 19:04:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b442df9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c'): ({'sdd'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Removing single pathed devices sdd {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.096s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[feabe918-7ca0-466f-adf2-9f6d5a4fbdb1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe4412-e742-4de4-a00c-57726b4d4ecb]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Flushing IO for device /dev/sdd {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45b0e6-9d00-4c09-913d-729bee8059b9]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[291eea79-16e9-495f-9851-d75284231ae5]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] SCSI volumes sdd have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40fde1-4b7a-467f-b130-06fd90a663bf]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1751bd8f-31a6-425b-9f4b-4d1338bc10fa]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260]
Nov 15 19:04:13 user nova-compute[75634]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c, portal: 172.16.0.220,3260] successful.
Nov 15 19:04:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2762536f-1c13-4dcc-b156-fecffbe25c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe83a74-35d7-4ef1-acae-e6fcae41d849]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] <== disconnect_volume: return (424ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:04:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:04:14 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Instance spawned successfully.
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:04:14 user nova-compute[75634]: INFO nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:04:14 user nova-compute[75634]: INFO nova.compute.manager [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Took 5.89 seconds to build instance.
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-cf4a1b16-1ac5-4783-818d-0cab3e5fd143 tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.982s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'flavor' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-521dd916-5073-4182-843a-06b23957ba19 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.041s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:14 user nova-compute[75634]: DEBUG nova.compute.manager [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] No waiting events found dispatching network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:14 user nova-compute[75634]: WARNING nova.compute.manager [req-389b56aa-82ab-4b14-bab4-407a3687b475 req-09314c20-bf64-4008-940d-11b19e726364 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received unexpected event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 for instance with vm_state active and task_state None.
Nov 15 19:04:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:15 user nova-compute[75634]: INFO nova.compute.manager [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Terminating instance
Nov 15 19:04:15 user nova-compute[75634]: DEBUG nova.compute.manager [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Instance destroyed successfully.
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.objects.instance [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lazy-loading 'resources' on Instance uuid a662ce10-e0cf-45ff-a365-15190a7b3078 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850015501',display_name='tempest-AttachVolumeTestJSON-server-850015501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850015501',id=48,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFbhmbkB7xw5pOr3ECpsjh1HSFhGq7HAkiwFAFr4BK+q5zj8sTvg+Y6X7TNiyb46hN5dBsaOKOXq7+cY9OfmChDqVxi21NZQJcQ8PJI+m0Ap91G7rWJGy/8WhRRER2yBA==',key_name='tempest-keypair-847738670',keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='812d9a6afc424b4eb1e6d50d3035531a',ramdisk_id='',reservation_id='r-l4shi9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-915928723',owner_user_name='tempest-AttachVolumeTestJSON-915928723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89755cafe30b4013b0642283a83bab00',uuid=a662ce10-e0cf-45ff-a365-15190a7b3078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converting VIF {"id": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "address": "fa:16:3e:34:9b:ea", "network": {"id": "54109a19-01fa-4503-9ca9-7ce34932dec0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822103866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "812d9a6afc424b4eb1e6d50d3035531a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa39cdc-b2", "ovs_interfaceid": "dfa39cdc-b2de-4f51-85fd-bc50af46a7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG os_vif [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa39cdc-b2, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3c509c9-bc44-4291-9941-e8ab9eb18af7) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:16 user nova-compute[75634]: INFO os_vif [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:ea,bridge_name='br-int',has_traffic_filtering=True,id=dfa39cdc-b2de-4f51-85fd-bc50af46a7be,network=Network(54109a19-01fa-4503-9ca9-7ce34932dec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa39cdc-b2')
Nov 15 19:04:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Deleting instance files /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078_del
Nov 15 19:04:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Deletion of /opt/stack/data/nova/instances/a662ce10-e0cf-45ff-a365-15190a7b3078_del complete
Nov 15 19:04:16 user nova-compute[75634]: INFO nova.compute.manager [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-unplugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] No waiting events found dispatching network-vif-unplugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-unplugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Acquiring lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:16 user nova-compute[75634]: DEBUG nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] No waiting events found dispatching network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:16 user nova-compute[75634]: WARNING nova.compute.manager [req-8ea83bb2-bb75-47af-a1fb-fc79f7e2af2d req-6f9b2d8b-68d5-458d-89e8-6ad1967077d1 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received unexpected event network-vif-plugged-dfa39cdc-b2de-4f51-85fd-bc50af46a7be for instance with vm_state active and task_state deleting.
Nov 15 19:04:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:17 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Took 0.76 seconds to deallocate network for instance.
Nov 15 19:04:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-76b1797e-7cfb-436c-806f-c9d553ec84a8 req-bd23e8fd-cdcb-4d10-b367-2bfbe0e0f513 service nova] [instance: a662ce10-e0cf-45ff-a365-15190a7b3078] Received event network-vif-deleted-dfa39cdc-b2de-4f51-85fd-bc50af46a7be {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:04:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:17 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Deleted allocations for instance a662ce10-e0cf-45ff-a365-15190a7b3078
Nov 15 19:04:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-a2a700e0-9c59-4213-a0b7-4af828a1e733 tempest-AttachVolumeTestJSON-915928723 tempest-AttachVolumeTestJSON-915928723-project-member] Lock "a662ce10-e0cf-45ff-a365-15190a7b3078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:04:26 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-changed-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing instance network info cache due to event network-changed-b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] Acquiring lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] Acquired lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Refreshing network info cache for port b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:28 user nova-compute[75634]: INFO nova.compute.manager [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Terminating instance
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:28 user nova-compute[75634]: INFO nova.compute.manager [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Terminating instance
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:28 user nova-compute[75634]: DEBUG nova.compute.manager [req-244fe29f-9922-4147-b720-53d589f6ef44 req-beafa69f-354a-4e95-bf5e-ea8cfb68cd51 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updated VIF entry in instance network info cache for port b21652aa-9edb-45d7-951a-788920656c0f. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.neutron [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [{"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-a95c1db0-1432-4cbe-9edc-1823f5c59b15 req-40e42422-5046-4bbd-8cf5-00a3c2e812b2 service nova] Releasing lock "refresh_cache-d2ab1727-c3ab-4aad-801f-ce02290fc9dd" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Instance destroyed successfully.
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lazy-loading 'resources' on Instance uuid d2ab1727-c3ab-4aad-801f-ce02290fc9dd {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Instance destroyed successfully.
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.objects.instance [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lazy-loading 'resources' on Instance uuid 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T18:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126242064',display_name='tempest-TestShelveInstance-server-1126242064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126242064',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF07aZw0gcQjxvDbxvWlrt1WG+o2A2KaYtKUkHChzTsIPcmaxSCBPAIGMyetWzOgKbVLfWnZSsG9gYi11dH9zt6mprU2yfb/XESkkRPSKQHfH3N/mwYqVQ7nd+XEwvjhVA==',key_name='tempest-TestShelveInstance-1296001899',keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13a864fca2b14cb7b073b3f8574ea9b8',ramdisk_id='',reservation_id='r-o9h6r8d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437679720',owner_user_name='tempest-TestShelveInstance-437679720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:02:49Z,user_data=None,user_id='d7ffd656a0cc4f579c03d651715433d1',uuid=d2ab1727-c3ab-4aad-801f-ce02290fc9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converting VIF {"id": "b21652aa-9edb-45d7-951a-788920656c0f", "address": "fa:16:3e:43:99:45", "network": {"id": "2838b0e1-72eb-4c87-a32e-279ef5dff572", "bridge": "br-int", "label": "tempest-TestShelveInstance-1287443252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a864fca2b14cb7b073b3f8574ea9b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21652aa-9e", "ovs_interfaceid": "b21652aa-9edb-45d7-951a-788920656c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_vif [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083153962',display_name='tempest-VolumesActionsTest-instance-1083153962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083153962',id=49,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdccc654388c4d56bf31547347cd6878',ramdisk_id='',reservation_id='r-sskxqutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-429249022',owner_user_name='tempest-VolumesActionsTest-429249022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:02:40Z,user_data=None,user_id='65f505cdcf1a4d85919968e505aa7176',uuid=4c81fdc4-e0b0-4d29-886b-8a8340ce40e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converting VIF {"id": "3ec60fef-b312-4f27-8230-88a095d92864", "address": "fa:16:3e:f3:89:03", "network": {"id": "08b1ce10-8a03-4748-918c-c216423923bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2105938911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdccc654388c4d56bf31547347cd6878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec60fef-b3", "ovs_interfaceid": "3ec60fef-b312-4f27-8230-88a095d92864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_vif [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb21652aa-9e, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ec60fef-b3, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=296b69cb-429e-4c95-b658-7c209bfb7541) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61f0fa44-b84f-4329-957e-ff31b79f829e) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:04:29 user nova-compute[75634]: INFO os_vif [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:99:45,bridge_name='br-int',has_traffic_filtering=True,id=b21652aa-9edb-45d7-951a-788920656c0f,network=Network(2838b0e1-72eb-4c87-a32e-279ef5dff572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21652aa-9e')
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcEHupPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:04:29 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:04:29 user nova-compute[75634]: INFO os_vif [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:03,bridge_name='br-int',has_traffic_filtering=True,id=3ec60fef-b312-4f27-8230-88a095d92864,network=Network(08b1ce10-8a03-4748-918c-c216423923bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec60fef-b3')
Nov 15 19:04:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Deleting instance files /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4_del
Nov 15 19:04:29 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Deletion of /opt/stack/data/nova/instances/4c81fdc4-e0b0-4d29-886b-8a8340ce40e4_del complete
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e6681-5c72-49e9-92a0-baec4127bc27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:04:29 user nova-compute[75634]: No targets found.
Nov 15 19:04:29 user nova-compute[75634]: iSNS:
Nov 15 19:04:29 user nova-compute[75634]: No targets found.
Nov 15 19:04:29 user nova-compute[75634]: STATIC:
Nov 15 19:04:29 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708
Nov 15 19:04:29 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:04:29 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:04:29 user nova-compute[75634]: FIRMWARE:
Nov 15 19:04:29 user nova-compute[75634]: No targets found.
Nov 15 19:04:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:04:29 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:04:29 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1808abb9-6c46-4d2c-b31c-463b2a17c3ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573662c-4907-463f-aa93-a3017f338d6e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:04:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 (non-flash)
Nov 15 19:04:29 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b442df6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: INFO nova.compute.manager [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c269ce-74b4-4c6d-b1a4-94b3f49d904a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c59434-1d25-4296-9ba1-12416c350e57]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f0cdf-e18c-407c-8f12-c0d1c41076df]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:04:29 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce0600-8d48-4358-bac3-93eecb8f9abe]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a881be-0c7a-4399-b46a-3d68767bc0b0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb776471-fcf6-4a8e-a128-479293c308e2]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260]
Nov 15 19:04:30 user nova-compute[75634]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708, portal: 172.16.0.220,3260] successful.
Nov 15 19:04:30 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bcff69-6349-4196-9987-6dce55b5e708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd267b-9b32-4261-9aa1-b992d0e24f6d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] <== disconnect_volume: return (372ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:04:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deleting instance files /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd_del
Nov 15 19:04:30 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deletion of /opt/stack/data/nova/instances/d2ab1727-c3ab-4aad-801f-ce02290fc9dd_del complete
Nov 15 19:04:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:30 user nova-compute[75634]: INFO nova.compute.manager [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Took 1.90 seconds to destroy the instance on the hypervisor.
Nov 15 19:04:30 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:30 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Took 1.06 seconds to deallocate network for instance.
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-728273da-5ef9-466c-90a7-885634edf94b req-8b40f3da-c29b-40b2-8b62-b0d0d0981822 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-vif-deleted-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:30 user nova-compute[75634]: INFO nova.compute.manager [req-728273da-5ef9-466c-90a7-885634edf94b req-8b40f3da-c29b-40b2-8b62-b0d0d0981822 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Neutron deleted interface 3ec60fef-b312-4f27-8230-88a095d92864; detaching it from the instance and deleting it from the info cache
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.network.neutron [req-728273da-5ef9-466c-90a7-885634edf94b req-8b40f3da-c29b-40b2-8b62-b0d0d0981822 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-728273da-5ef9-466c-90a7-885634edf94b req-8b40f3da-c29b-40b2-8b62-b0d0d0981822 service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Detach interface failed, port_id=3ec60fef-b312-4f27-8230-88a095d92864, reason: Instance 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4 could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: WARNING nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state deleting.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-vif-unplugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] No waiting events found dispatching network-vif-unplugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: WARNING nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received unexpected event network-vif-unplugged-3ec60fef-b312-4f27-8230-88a095d92864 for instance with vm_state deleted and task_state None.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] No waiting events found dispatching network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: WARNING nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4] Received unexpected event network-vif-plugged-3ec60fef-b312-4f27-8230-88a095d92864 for instance with vm_state deleted and task_state None.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: WARNING nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state deleting.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: WARNING nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state active and task_state deleting.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [req-5465cd22-9310-46f1-9afe-f3491bce9e29 req-32b7de64-13c6-4eea-841e-8fb9a3b214dd service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-unplugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:04:31 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Took 0.86 seconds to deallocate network for instance.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Deleted allocations for instance 4c81fdc4-e0b0-4d29-886b-8a8340ce40e4
Nov 15 19:04:31 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-9fb7c714-0afa-4221-9038-87c481befab6 tempest-VolumesActionsTest-429249022 tempest-VolumesActionsTest-429249022-project-member] Lock "4c81fdc4-e0b0-4d29-886b-8a8340ce40e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.685s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:31 user nova-compute[75634]: INFO nova.compute.manager [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 19:04:31 user nova-compute[75634]: DEBUG nova.compute.manager [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Deleting volume: 65bcff69-6349-4196-9987-6dce55b5e708 {{(pid=75634) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 19:04:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:32 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:04:32 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:04:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:32 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Deleted allocations for instance d2ab1727-c3ab-4aad-801f-ce02290fc9dd
Nov 15 19:04:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-34ecd35d-2d8b-4fa7-a2cd-7d5486dd1f8f tempest-TestShelveInstance-437679720 tempest-TestShelveInstance-437679720-project-member] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.978s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] Acquiring lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] Lock "d2ab1727-c3ab-4aad-801f-ce02290fc9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] No waiting events found dispatching network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:04:33 user nova-compute[75634]: WARNING nova.compute.manager [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received unexpected event network-vif-plugged-b21652aa-9edb-45d7-951a-788920656c0f for instance with vm_state deleted and task_state None.
Nov 15 19:04:33 user nova-compute[75634]: DEBUG nova.compute.manager [req-938dfc6a-a0e9-4b51-bdf8-beb7788953a6 req-e8c29bc0-fd8d-4989-8a86-70affc4d116c service nova] [instance: d2ab1727-c3ab-4aad-801f-ce02290fc9dd] Received event network-vif-deleted-b21652aa-9edb-45d7-951a-788920656c0f {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:04:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:40 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:41 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:04:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:04:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:04:43 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=25.041240692138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 40b1e69f-cafe-495a-8b48-166e59d8f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:04:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:04:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid 40b1e69f-cafe-495a-8b48-166e59d8f320 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updating instance_info_cache with network_info: [{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:04:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:04:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:04:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:04:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:04:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:02 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:05:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:41 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:42 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:05:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.027488708496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 40b1e69f-cafe-495a-8b48-166e59d8f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance bb27fa20-c2f7-4e34-9968-7a8c003cbb36 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.046s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:05:44 user nova-compute[75634]: INFO nova.compute.claims [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Claim successful on node user
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.policy [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca0f9475385048fa931604797506c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cba109390f34556a9061e3d6caa4652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:05:44 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Creating image(s)
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "/opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "/opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk 1073741824" returned: 0 in 0.058s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Successfully created port: 60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Cannot resize image /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Ensure instance console log exists: /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Successfully updated port: 60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquired lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-changed-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.compute.manager [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Refreshing instance network info cache due to event network-changed-60255e17-66b4-4078-8911-9b196226e25d. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] Acquiring lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.neutron [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updating instance_info_cache with network_info: [{"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Releasing lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Instance network_info: |[{"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] Acquired lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.neutron [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Refreshing network info cache for port 60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Start _get_guest_xml network_info=[{"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:05:46 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:05:46 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1645942416',display_name='tempest-VolumesActionsTest-instance-1645942416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1645942416',id=51,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-0w99fac1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:05:45Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=bb27fa20-c2f7-4e34-9968-7a8c003cbb36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lazy-loading 'pci_devices' on Instance uuid bb27fa20-c2f7-4e34-9968-7a8c003cbb36 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:05:46 user nova-compute[75634]:   <uuid>bb27fa20-c2f7-4e34-9968-7a8c003cbb36</uuid>
Nov 15 19:05:46 user nova-compute[75634]:   <name>instance-00000033</name>
Nov 15 19:05:46 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:05:46 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:05:46 user nova-compute[75634]:   <metadata>
Nov 15 19:05:46 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:05:46 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:name>tempest-VolumesActionsTest-instance-1645942416</nova:name>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:05:46</nova:creationTime>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:05:46 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:05:46 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:owner>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:user uuid="ca0f9475385048fa931604797506c3c1">tempest-VolumesActionsTest-457155668-project-member</nova:user>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:project uuid="4cba109390f34556a9061e3d6caa4652">tempest-VolumesActionsTest-457155668</nova:project>
Nov 15 19:05:46 user nova-compute[75634]:       </nova:owner>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:05:46 user nova-compute[75634]:       <nova:ports>
Nov 15 19:05:46 user nova-compute[75634]:         <nova:port uuid="60255e17-66b4-4078-8911-9b196226e25d">
Nov 15 19:05:46 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 19:05:46 user nova-compute[75634]:         </nova:port>
Nov 15 19:05:46 user nova-compute[75634]:       </nova:ports>
Nov 15 19:05:46 user nova-compute[75634]:     </nova:instance>
Nov 15 19:05:46 user nova-compute[75634]:   </metadata>
Nov 15 19:05:46 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:05:46 user nova-compute[75634]:     <system>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="serial">bb27fa20-c2f7-4e34-9968-7a8c003cbb36</entry>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="uuid">bb27fa20-c2f7-4e34-9968-7a8c003cbb36</entry>
Nov 15 19:05:46 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:05:46 user nova-compute[75634]:     </system>
Nov 15 19:05:46 user nova-compute[75634]:   </sysinfo>
Nov 15 19:05:46 user nova-compute[75634]:   <os>
Nov 15 19:05:46 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:05:46 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:05:46 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:05:46 user nova-compute[75634]:   </os>
Nov 15 19:05:46 user nova-compute[75634]:   <features>
Nov 15 19:05:46 user nova-compute[75634]:     <acpi/>
Nov 15 19:05:46 user nova-compute[75634]:     <apic/>
Nov 15 19:05:46 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:05:46 user nova-compute[75634]:   </features>
Nov 15 19:05:46 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:05:46 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:05:46 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:05:46 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:05:46 user nova-compute[75634]:   </clock>
Nov 15 19:05:46 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:05:46 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:05:46 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:05:46 user nova-compute[75634]:   </cpu>
Nov 15 19:05:46 user nova-compute[75634]:   <devices>
Nov 15 19:05:46 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:05:46 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:05:46 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk"/>
Nov 15 19:05:46 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:05:46 user nova-compute[75634]:     </disk>
Nov 15 19:05:46 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:05:46 user nova-compute[75634]:       <mac address="fa:16:3e:d2:fe:5e"/>
Nov 15 19:05:46 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:05:46 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:05:46 user nova-compute[75634]:       <target dev="tap60255e17-66"/>
Nov 15 19:05:46 user nova-compute[75634]:     </interface>
Nov 15 19:05:46 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:05:46 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/console.log" append="off"/>
Nov 15 19:05:46 user nova-compute[75634]:     </serial>
Nov 15 19:05:46 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:05:46 user nova-compute[75634]:     <video>
Nov 15 19:05:46 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:05:46 user nova-compute[75634]:     </video>
Nov 15 19:05:46 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:05:46 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:05:46 user nova-compute[75634]:     </rng>
Nov 15 19:05:46 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:05:46 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:05:46 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:05:46 user nova-compute[75634]:     </memballoon>
Nov 15 19:05:46 user nova-compute[75634]:   </devices>
Nov 15 19:05:46 user nova-compute[75634]: </domain>
Nov 15 19:05:46 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1645942416',display_name='tempest-VolumesActionsTest-instance-1645942416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1645942416',id=51,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-0w99fac1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:05:45Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=bb27fa20-c2f7-4e34-9968-7a8c003cbb36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG os_vif [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b873bac8-3537-577e-965d-7e4522eca43c', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60255e17-66, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60255e17-66, col_values=(('qos', UUID('7fda8a01-e3fc-4e12-9f4d-1dce03fe9faa')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60255e17-66, col_values=(('external_ids', {'iface-id': '60255e17-66b4-4078-8911-9b196226e25d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:fe:5e', 'vm-uuid': 'bb27fa20-c2f7-4e34-9968-7a8c003cbb36'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: INFO os_vif [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66')
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] No VIF found with MAC fa:16:3e:d2:fe:5e, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updated VIF entry in instance network info cache for port 60255e17-66b4-4078-8911-9b196226e25d. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.network.neutron [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updating instance_info_cache with network_info: [{"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-b54a3a54-7981-40a4-bd5f-4113480bc8de req-83b8485d-8e62-43ee-9a6f-652e986241cb service nova] Releasing lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Skipping network cache update for instance because it is Building. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid 40b1e69f-cafe-495a-8b48-166e59d8f320 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updating instance_info_cache with network_info: [{"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-40b1e69f-cafe-495a-8b48-166e59d8f320" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:05:47 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG nova.compute.manager [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] No waiting events found dispatching network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:05:48 user nova-compute[75634]: WARNING nova.compute.manager [req-ec6cf6ef-3bd5-4016-a79a-5381da059888 req-bff4c93b-04e5-401e-bbde-694060145635 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received unexpected event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d for instance with vm_state building and task_state spawning.
Nov 15 19:05:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:05:50 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Instance spawned successfully.
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:05:50 user nova-compute[75634]: INFO nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:05:50 user nova-compute[75634]: INFO nova.compute.manager [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Took 5.95 seconds to build instance.
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:50 user nova-compute[75634]: DEBUG nova.compute.manager [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] No waiting events found dispatching network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:05:50 user nova-compute[75634]: WARNING nova.compute.manager [req-825ec5d9-3a82-40c0-8d98-abcd479b1929 req-448e99b7-58f5-4aa0-abc5-59e8efc86a84 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received unexpected event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d for instance with vm_state active and task_state None.
Nov 15 19:05:50 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c3be0f38-7e66-46ac-9831-7772a1d2f9e9 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.059s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:58 user nova-compute[75634]: INFO nova.compute.manager [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Terminating instance
Nov 15 19:05:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-unplugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] No waiting events found dispatching network-vif-unplugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.compute.manager [req-e5d18f0e-de0a-41d5-96ce-22b84e8a3653 req-fb8a73f5-8d18-4ef8-8b29-f78bf3fdd8c2 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-unplugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:05:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Instance destroyed successfully.
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lazy-loading 'resources' on Instance uuid 40b1e69f-cafe-495a-8b48-166e59d8f320 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-817290497',display_name='tempest-VolumesNegativeTest-instance-817290497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-817290497',id=50,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e774ccbcb74a4381ab9941f5f5fd16',ramdisk_id='',reservation_id='r-a7bxeo1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-994322683',owner_user_name='tempest-VolumesNegativeTest-994322683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:04:15Z,user_data=None,user_id='2be2a360f4c548f68b795fad9b53ec41',uuid=40b1e69f-cafe-495a-8b48-166e59d8f320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converting VIF {"id": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "address": "fa:16:3e:bf:15:54", "network": {"id": "1a843e55-b417-4138-8542-b6854d31a6e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "98149cd6f35940629db0f69188db4d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ea4c8d-ef", "ovs_interfaceid": "a1ea4c8d-efed-4c20-b3e0-e6054ce6b030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG os_vif [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1ea4c8d-ef, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5aaa76d-bc1d-4690-9f43-9e16e4bd0a34) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:05:59 user nova-compute[75634]: INFO os_vif [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:15:54,bridge_name='br-int',has_traffic_filtering=True,id=a1ea4c8d-efed-4c20-b3e0-e6054ce6b030,network=Network(1a843e55-b417-4138-8542-b6854d31a6e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ea4c8d-ef')
Nov 15 19:05:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Deleting instance files /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320_del
Nov 15 19:05:59 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Deletion of /opt/stack/data/nova/instances/40b1e69f-cafe-495a-8b48-166e59d8f320_del complete
Nov 15 19:05:59 user nova-compute[75634]: INFO nova.compute.manager [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 19:05:59 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:05:59 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:06:00 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Took 0.47 seconds to deallocate network for instance.
Nov 15 19:06:00 user nova-compute[75634]: DEBUG nova.compute.manager [req-6100d7da-401f-4e7c-b198-0f137e6e4ee9 req-b77eb5bf-0255-4afd-8697-bd928e58acd8 service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-deleted-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:06:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:06:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:06:00 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:06:00 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:06:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:06:00 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Deleted allocations for instance 40b1e69f-cafe-495a-8b48-166e59d8f320
Nov 15 19:06:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-0ff9cf05-7b8d-45c0-822c-1aee1e49a51c tempest-VolumesNegativeTest-994322683 tempest-VolumesNegativeTest-994322683-project-member] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.718s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:06:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:06:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] Acquiring lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:06:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:06:01 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] Lock "40b1e69f-cafe-495a-8b48-166e59d8f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:06:01 user nova-compute[75634]: DEBUG nova.compute.manager [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] No waiting events found dispatching network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:06:01 user nova-compute[75634]: WARNING nova.compute.manager [req-0e6407d9-d6d3-4e18-8e1d-66b52cb63dce req-012084b3-e7ae-4ce0-a189-fa03335d73ef service nova] [instance: 40b1e69f-cafe-495a-8b48-166e59d8f320] Received unexpected event network-vif-plugged-a1ea4c8d-efed-4c20-b3e0-e6054ce6b030 for instance with vm_state deleted and task_state None.
Nov 15 19:06:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:06 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:11 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:16 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:21 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:06:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:06:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:06:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:06:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=25.01593780517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance bb27fa20-c2f7-4e34-9968-7a8c003cbb36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:06:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:06:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid bb27fa20-c2f7-4e34-9968-7a8c003cbb36 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updating instance_info_cache with network_info: [{"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-bb27fa20-c2f7-4e34-9968-7a8c003cbb36" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:06:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:06:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:06:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:07:05 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:07:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:34 user nova-compute[75634]: INFO nova.compute.manager [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Terminating instance
Nov 15 19:07:34 user nova-compute[75634]: DEBUG nova.compute.manager [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-unplugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] No waiting events found dispatching network-vif-unplugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:07:34 user nova-compute[75634]: DEBUG nova.compute.manager [req-f443a08c-7015-473b-a8c2-4df99bc0d533 req-d1bdc839-bdc8-49a0-9374-a05f9028413a service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-unplugged-60255e17-66b4-4078-8911-9b196226e25d for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:07:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Instance destroyed successfully.
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lazy-loading 'resources' on Instance uuid bb27fa20-c2f7-4e34-9968-7a8c003cbb36 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1645942416',display_name='tempest-VolumesActionsTest-instance-1645942416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1645942416',id=51,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-0w99fac1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:05:50Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=bb27fa20-c2f7-4e34-9968-7a8c003cbb36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "60255e17-66b4-4078-8911-9b196226e25d", "address": "fa:16:3e:d2:fe:5e", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60255e17-66", "ovs_interfaceid": "60255e17-66b4-4078-8911-9b196226e25d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG os_vif [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60255e17-66, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fda8a01-e3fc-4e12-9f4d-1dce03fe9faa) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:07:35 user nova-compute[75634]: INFO os_vif [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fe:5e,bridge_name='br-int',has_traffic_filtering=True,id=60255e17-66b4-4078-8911-9b196226e25d,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60255e17-66')
Nov 15 19:07:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Deleting instance files /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36_del
Nov 15 19:07:35 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Deletion of /opt/stack/data/nova/instances/bb27fa20-c2f7-4e34-9968-7a8c003cbb36_del complete
Nov 15 19:07:35 user nova-compute[75634]: INFO nova.compute.manager [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 19:07:35 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:07:35 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:07:36 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:07:36 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Took 0.42 seconds to deallocate network for instance.
Nov 15 19:07:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:36 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:07:36 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:07:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:36 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Deleted allocations for instance bb27fa20-c2f7-4e34-9968-7a8c003cbb36
Nov 15 19:07:36 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-986fec99-a477-4ee9-ba16-441d3e5a4f43 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.565s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:07:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] Acquiring lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:37 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] Lock "bb27fa20-c2f7-4e34-9968-7a8c003cbb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] No waiting events found dispatching network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:07:37 user nova-compute[75634]: WARNING nova.compute.manager [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received unexpected event network-vif-plugged-60255e17-66b4-4078-8911-9b196226e25d for instance with vm_state deleted and task_state None.
Nov 15 19:07:37 user nova-compute[75634]: DEBUG nova.compute.manager [req-abf3d134-4a2a-4a9d-bc81-dcac79af2fa8 req-12843d1c-bf7d-44cb-86c8-94cab8935899 service nova] [instance: bb27fa20-c2f7-4e34-9968-7a8c003cbb36] Received event network-vif-deleted-60255e17-66b4-4078-8911-9b196226e25d {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:07:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:43 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:44 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:07:45 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:07:45 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=25.042579650878906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:07:45 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:07:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:07:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:47 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:49 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:07:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:07:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:07:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 19:07:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 19:07:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:08:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:08:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:08:26 user nova-compute[75634]: INFO nova.compute.claims [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Claim successful on node user
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:08:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.policy [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca0f9475385048fa931604797506c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cba109390f34556a9061e3d6caa4652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:08:26 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Creating image(s)
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "/opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "/opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:26 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Successfully created port: 0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk 1073741824" returned: 0 in 0.060s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Cannot resize image /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Ensure instance console log exists: /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Successfully updated port: 0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquired lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-changed-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.compute.manager [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Refreshing instance network info cache due to event network-changed-0447724c-5300-4300-8a40-d4ea398116d1. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] Acquiring lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:08:27 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.neutron [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Releasing lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Instance network_info: |[{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] Acquired lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Refreshing network info cache for port 0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Start _get_guest_xml network_info=[{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:08:28 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:08:28 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-501963844',display_name='tempest-VolumesActionsTest-instance-501963844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-501963844',id=52,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-mzg0hqbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:08:27Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=3c8fe198-3f2e-4d79-9943-7920a483caee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.objects.instance [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c8fe198-3f2e-4d79-9943-7920a483caee {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:08:28 user nova-compute[75634]:   <uuid>3c8fe198-3f2e-4d79-9943-7920a483caee</uuid>
Nov 15 19:08:28 user nova-compute[75634]:   <name>instance-00000034</name>
Nov 15 19:08:28 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:08:28 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:08:28 user nova-compute[75634]:   <metadata>
Nov 15 19:08:28 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:08:28 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:name>tempest-VolumesActionsTest-instance-501963844</nova:name>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:08:28</nova:creationTime>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:08:28 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:08:28 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:owner>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:user uuid="ca0f9475385048fa931604797506c3c1">tempest-VolumesActionsTest-457155668-project-member</nova:user>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:project uuid="4cba109390f34556a9061e3d6caa4652">tempest-VolumesActionsTest-457155668</nova:project>
Nov 15 19:08:28 user nova-compute[75634]:       </nova:owner>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:08:28 user nova-compute[75634]:       <nova:ports>
Nov 15 19:08:28 user nova-compute[75634]:         <nova:port uuid="0447724c-5300-4300-8a40-d4ea398116d1">
Nov 15 19:08:28 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 19:08:28 user nova-compute[75634]:         </nova:port>
Nov 15 19:08:28 user nova-compute[75634]:       </nova:ports>
Nov 15 19:08:28 user nova-compute[75634]:     </nova:instance>
Nov 15 19:08:28 user nova-compute[75634]:   </metadata>
Nov 15 19:08:28 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:08:28 user nova-compute[75634]:     <system>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="serial">3c8fe198-3f2e-4d79-9943-7920a483caee</entry>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="uuid">3c8fe198-3f2e-4d79-9943-7920a483caee</entry>
Nov 15 19:08:28 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:08:28 user nova-compute[75634]:     </system>
Nov 15 19:08:28 user nova-compute[75634]:   </sysinfo>
Nov 15 19:08:28 user nova-compute[75634]:   <os>
Nov 15 19:08:28 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:08:28 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:08:28 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:08:28 user nova-compute[75634]:   </os>
Nov 15 19:08:28 user nova-compute[75634]:   <features>
Nov 15 19:08:28 user nova-compute[75634]:     <acpi/>
Nov 15 19:08:28 user nova-compute[75634]:     <apic/>
Nov 15 19:08:28 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:08:28 user nova-compute[75634]:   </features>
Nov 15 19:08:28 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:08:28 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:08:28 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:08:28 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:08:28 user nova-compute[75634]:   </clock>
Nov 15 19:08:28 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:08:28 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:08:28 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:08:28 user nova-compute[75634]:   </cpu>
Nov 15 19:08:28 user nova-compute[75634]:   <devices>
Nov 15 19:08:28 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:08:28 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:08:28 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk"/>
Nov 15 19:08:28 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:08:28 user nova-compute[75634]:     </disk>
Nov 15 19:08:28 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:08:28 user nova-compute[75634]:       <mac address="fa:16:3e:f9:86:fb"/>
Nov 15 19:08:28 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:08:28 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:08:28 user nova-compute[75634]:       <target dev="tap0447724c-53"/>
Nov 15 19:08:28 user nova-compute[75634]:     </interface>
Nov 15 19:08:28 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:08:28 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/console.log" append="off"/>
Nov 15 19:08:28 user nova-compute[75634]:     </serial>
Nov 15 19:08:28 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:08:28 user nova-compute[75634]:     <video>
Nov 15 19:08:28 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:08:28 user nova-compute[75634]:     </video>
Nov 15 19:08:28 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:08:28 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:08:28 user nova-compute[75634]:     </rng>
Nov 15 19:08:28 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:08:28 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:08:28 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:08:28 user nova-compute[75634]:     </memballoon>
Nov 15 19:08:28 user nova-compute[75634]:   </devices>
Nov 15 19:08:28 user nova-compute[75634]: </domain>
Nov 15 19:08:28 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-501963844',display_name='tempest-VolumesActionsTest-instance-501963844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-501963844',id=52,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-mzg0hqbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:08:27Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=3c8fe198-3f2e-4d79-9943-7920a483caee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG os_vif [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3e66de8-adcc-5bfb-9fda-4fb0bd5de5f2', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0447724c-53, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0447724c-53, col_values=(('qos', UUID('7c70e194-d55b-43d3-9e62-94a8516a8f59')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0447724c-53, col_values=(('external_ids', {'iface-id': '0447724c-5300-4300-8a40-d4ea398116d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:86:fb', 'vm-uuid': '3c8fe198-3f2e-4d79-9943-7920a483caee'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:28 user nova-compute[75634]: INFO os_vif [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53')
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] No VIF found with MAC fa:16:3e:f9:86:fb, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updated VIF entry in instance network info cache for port 0447724c-5300-4300-8a40-d4ea398116d1. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG nova.network.neutron [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:08:28 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-6789d92c-b8ae-4157-861f-a72877e9ad0d req-fce91cdf-4e9e-415c-bd47-d1ee4e008dd4 service nova] Releasing lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:08:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG nova.compute.manager [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] No waiting events found dispatching network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:08:30 user nova-compute[75634]: WARNING nova.compute.manager [req-5c33ea1e-acde-400e-ac36-78d779c99799 req-d92b0bcc-9f20-498d-95c4-d2d9526931b6 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received unexpected event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 for instance with vm_state building and task_state spawning.
Nov 15 19:08:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:31 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:08:32 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Instance spawned successfully.
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:08:32 user nova-compute[75634]: INFO nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:08:32 user nova-compute[75634]: INFO nova.compute.manager [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Took 5.87 seconds to build instance.
Nov 15 19:08:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-46ceb60d-eccf-4478-a73f-5a80a5c164e4 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.953s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] No waiting events found dispatching network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:08:32 user nova-compute[75634]: WARNING nova.compute.manager [req-c6994685-786c-45f7-bdcc-6fa0948bee5b req-b6877c35-d09c-4c8b-9d2f-94579be78707 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received unexpected event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 for instance with vm_state active and task_state None.
Nov 15 19:08:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:08:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:08:47 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=25.006954193115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 3c8fe198-3f2e-4d79-9943-7920a483caee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:08:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:08:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:50 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid 3c8fe198-3f2e-4d79-9943-7920a483caee {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:08:51 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:56 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:08:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:05 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:18 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:23 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:28 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:09:33 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:43 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:46 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:09:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:09:49 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:09:49 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.004711151123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance 3c8fe198-3f2e-4d79-9943-7920a483caee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:09:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:09:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid 3c8fe198-3f2e-4d79-9943-7920a483caee {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [{"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-3c8fe198-3f2e-4d79-9943-7920a483caee" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:09:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:09:58 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:03 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:08 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:13 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:17 user nova-compute[75634]: INFO nova.compute.manager [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Terminating instance
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.compute.manager [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-unplugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] No waiting events found dispatching network-vif-unplugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.compute.manager [req-d445a3c0-259d-4e5f-8757-584c39c6cbe7 req-4a996a48-e832-4c8c-ac9c-d8ff57d49c06 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-unplugged-0447724c-5300-4300-8a40-d4ea398116d1 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Instance destroyed successfully.
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.objects.instance [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lazy-loading 'resources' on Instance uuid 3c8fe198-3f2e-4d79-9943-7920a483caee {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-501963844',display_name='tempest-VolumesActionsTest-instance-501963844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-501963844',id=52,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:08:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cba109390f34556a9061e3d6caa4652',ramdisk_id='',reservation_id='r-mzg0hqbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-457155668',owner_user_name='tempest-VolumesActionsTest-457155668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:08:32Z,user_data=None,user_id='ca0f9475385048fa931604797506c3c1',uuid=3c8fe198-3f2e-4d79-9943-7920a483caee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converting VIF {"id": "0447724c-5300-4300-8a40-d4ea398116d1", "address": "fa:16:3e:f9:86:fb", "network": {"id": "5ed8b6ee-c35d-43b3-9a45-87f027269367", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558646573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cba109390f34556a9061e3d6caa4652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0447724c-53", "ovs_interfaceid": "0447724c-5300-4300-8a40-d4ea398116d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG os_vif [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0447724c-53, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c70e194-d55b-43d3-9e62-94a8516a8f59) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:17 user nova-compute[75634]: INFO os_vif [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:fb,bridge_name='br-int',has_traffic_filtering=True,id=0447724c-5300-4300-8a40-d4ea398116d1,network=Network(5ed8b6ee-c35d-43b3-9a45-87f027269367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0447724c-53')
Nov 15 19:10:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Deleting instance files /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee_del
Nov 15 19:10:17 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Deletion of /opt/stack/data/nova/instances/3c8fe198-3f2e-4d79-9943-7920a483caee_del complete
Nov 15 19:10:17 user nova-compute[75634]: INFO nova.compute.manager [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 19:10:17 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:10:17 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:10:18 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Took 0.44 seconds to deallocate network for instance.
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-1df48b45-3d0a-4cc4-bb83-27e75b0bb24f req-a16293de-45f9-472a-b6f8-6b25d3a71f03 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-deleted-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:10:18 user nova-compute[75634]: INFO nova.compute.manager [req-1df48b45-3d0a-4cc4-bb83-27e75b0bb24f req-a16293de-45f9-472a-b6f8-6b25d3a71f03 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Neutron deleted interface 0447724c-5300-4300-8a40-d4ea398116d1; detaching it from the instance and deleting it from the info cache
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.network.neutron [req-1df48b45-3d0a-4cc4-bb83-27e75b0bb24f req-a16293de-45f9-472a-b6f8-6b25d3a71f03 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.compute.manager [req-1df48b45-3d0a-4cc4-bb83-27e75b0bb24f req-a16293de-45f9-472a-b6f8-6b25d3a71f03 service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Detach interface failed, port_id=0447724c-5300-4300-8a40-d4ea398116d1, reason: Instance 3c8fe198-3f2e-4d79-9943-7920a483caee could not be found. {{(pid=75634) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:10:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:18 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Deleted allocations for instance 3c8fe198-3f2e-4d79-9943-7920a483caee
Nov 15 19:10:18 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-e77d885a-2f07-4e68-84cf-cade75bd1204 tempest-VolumesActionsTest-457155668 tempest-VolumesActionsTest-457155668-project-member] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.563s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:10:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] Acquiring lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] Lock "3c8fe198-3f2e-4d79-9943-7920a483caee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:19 user nova-compute[75634]: DEBUG nova.compute.manager [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] No waiting events found dispatching network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:10:19 user nova-compute[75634]: WARNING nova.compute.manager [req-fad81b4f-02f5-4ea2-8965-9e5e6eb928d4 req-b1624dc5-cf87-4a4a-9226-19c9d0adabad service nova] [instance: 3c8fe198-3f2e-4d79-9943-7920a483caee] Received unexpected event network-vif-plugged-0447724c-5300-4300-8a40-d4ea398116d1 for instance with vm_state deleted and task_state None.
Nov 15 19:10:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:10:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:10:49 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:10:49 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=9105MB free_disk=25.031932830810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:10:49 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:10:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:10:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:10:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:10:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:10:53 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 19:10:55 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:10:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:09 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:11:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:48 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:11:51 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:11:51 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.030418395996094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:11:51 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:11:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:11:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:11:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 19:11:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:11:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Verify base images {{(pid=75634) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa
Nov 15 19:12:13 user nova-compute[75634]: WARNING nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Removable base files: /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3 /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09 /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6abf19a7a2859970169a105436aca88018680aab
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d3883111a7eff1707485a8be15904c0f553bffb
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6656b8db79b16d9685dc553268a7b2c661ffa8d3
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82be5b3b0fdcca2997ac3636ace1acdc572305ea
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62bbec68958a70b3232e74818c605cfd01a5d5ac
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c41684f6d409169542a2f3188a80ddf958d22ffa
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/18116f038e14afafe4e5882cb15bf8d86cac2e09
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/136756019ae4d8bc93c2218f43b7b2f70a3d96fa
Nov 15 19:12:13 user nova-compute[75634]: INFO nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fffde95de9686bcf2be82ea435fd6d044ea255d7
Nov 15 19:12:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Verification complete {{(pid=75634) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Verify swap images {{(pid=75634) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 19:12:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.imagecache [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Verify ephemeral images {{(pid=75634) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 19:12:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:27 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:32 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:36 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:38 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Starting instance... {{(pid=75634) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:41 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75634) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 19:12:41 user nova-compute[75634]: INFO nova.compute.claims [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Claim successful on node user
Nov 15 19:12:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Start building networks asynchronously for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Allocating IP information in the background. {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] allocate_for_instance() {{(pid=75634) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 19:12:42 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Start building block device mappings for instance. {{(pid=75634) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Start spawning the instance on the hypervisor. {{(pid=75634) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Creating instance directory {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 19:12:42 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Creating image(s)
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "/opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "/opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG nova.policy [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfc2bd3fb8c24cab9e1cf15529474a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a963091d182847ffb3cc6bfeff81ec3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75634) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "d514e314d2f732695e361aefbbe87229316e51c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.242s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk 1073741824 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9,backing_fmt=raw /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk 1073741824" returned: 0 in 0.052s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "d514e314d2f732695e361aefbbe87229316e51c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d514e314d2f732695e361aefbbe87229316e51c9 --force-share --output=json" returned: 0 in 0.243s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk. size=1073741824 {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG nova.virt.disk.api [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Cannot resize image /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk to a smaller size. {{(pid=75634) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Created local disks {{(pid=75634) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Ensure instance console log exists: /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/console.log {{(pid=75634) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:43 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Successfully created port: c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Successfully updated port: c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Building network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Instance cache missing network info. {{(pid=75634) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.neutron [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Instance network_info: |[{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75634) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Start _get_guest_xml network_info=[{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'image_id': '2c2255c9-a9c5-4496-8a92-18849f2ce081'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 19:12:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:12:44 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CPU controller missing on host. {{(pid=75634) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.host [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CPU controller found on host. {{(pid=75634) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75634) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T18:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T18:32:42Z,direct_url=<?>,disk_format='qcow2',id=2c2255c9-a9c5-4496-8a92-18849f2ce081,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='98149cd6f35940629db0f69188db4d03',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T18:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flavor limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Image limits 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flavor pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Image pref 0:0:0 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Got 1 possible topologies {{(pid=75634) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.hardware [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75634) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063650665',display_name='tempest-SnapshotDataIntegrityTests-server-1063650665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063650665',id=53,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOig/SfsqEQXBmj5SDVCEhcsitDOQzqHHkBvX+xYKgJv1T5mYRrR8NQSFR4WhOsWghdPrUAa5d+WwEr6f5OOMFUM3SiU19onaA3q947VfTwJbe3ja6ERUFky6PwQkX8JOg==',key_name='tempest-keypair-2081629947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a963091d182847ffb3cc6bfeff81ec3b',ramdisk_id='',reservation_id='r-uajgc1ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-275038818',owner_user_name='tempest-SnapshotDataIntegrityTests-275038818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfc2bd3fb8c24cab9e1cf15529474a84',uuid=ddf39b22-5917-4bdb-b5d4-43d07591e764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75634) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converting VIF {"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.objects.instance [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'pci_devices' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] End _get_guest_xml xml=<domain type="kvm">
Nov 15 19:12:44 user nova-compute[75634]:   <uuid>ddf39b22-5917-4bdb-b5d4-43d07591e764</uuid>
Nov 15 19:12:44 user nova-compute[75634]:   <name>instance-00000035</name>
Nov 15 19:12:44 user nova-compute[75634]:   <memory>524288</memory>
Nov 15 19:12:44 user nova-compute[75634]:   <vcpu>1</vcpu>
Nov 15 19:12:44 user nova-compute[75634]:   <metadata>
Nov 15 19:12:44 user nova-compute[75634]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 19:12:44 user nova-compute[75634]:       <nova:package version="0.0.0"/>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1063650665</nova:name>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:creationTime>2023-11-15 19:12:44</nova:creationTime>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:flavor name="m1.tiny">
Nov 15 19:12:44 user nova-compute[75634]:         <nova:memory>512</nova:memory>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:disk>1</nova:disk>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:swap>0</nova:swap>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:vcpus>1</nova:vcpus>
Nov 15 19:12:44 user nova-compute[75634]:       </nova:flavor>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:owner>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:user uuid="cfc2bd3fb8c24cab9e1cf15529474a84">tempest-SnapshotDataIntegrityTests-275038818-project-member</nova:user>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:project uuid="a963091d182847ffb3cc6bfeff81ec3b">tempest-SnapshotDataIntegrityTests-275038818</nova:project>
Nov 15 19:12:44 user nova-compute[75634]:       </nova:owner>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:root type="image" uuid="2c2255c9-a9c5-4496-8a92-18849f2ce081"/>
Nov 15 19:12:44 user nova-compute[75634]:       <nova:ports>
Nov 15 19:12:44 user nova-compute[75634]:         <nova:port uuid="c3a70a06-c5bf-4977-a91b-74d879f63644">
Nov 15 19:12:44 user nova-compute[75634]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 19:12:44 user nova-compute[75634]:         </nova:port>
Nov 15 19:12:44 user nova-compute[75634]:       </nova:ports>
Nov 15 19:12:44 user nova-compute[75634]:     </nova:instance>
Nov 15 19:12:44 user nova-compute[75634]:   </metadata>
Nov 15 19:12:44 user nova-compute[75634]:   <sysinfo type="smbios">
Nov 15 19:12:44 user nova-compute[75634]:     <system>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="product">OpenStack Nova</entry>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="version">0.0.0</entry>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="serial">ddf39b22-5917-4bdb-b5d4-43d07591e764</entry>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="uuid">ddf39b22-5917-4bdb-b5d4-43d07591e764</entry>
Nov 15 19:12:44 user nova-compute[75634]:       <entry name="family">Virtual Machine</entry>
Nov 15 19:12:44 user nova-compute[75634]:     </system>
Nov 15 19:12:44 user nova-compute[75634]:   </sysinfo>
Nov 15 19:12:44 user nova-compute[75634]:   <os>
Nov 15 19:12:44 user nova-compute[75634]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 19:12:44 user nova-compute[75634]:     <boot dev="hd"/>
Nov 15 19:12:44 user nova-compute[75634]:     <smbios mode="sysinfo"/>
Nov 15 19:12:44 user nova-compute[75634]:   </os>
Nov 15 19:12:44 user nova-compute[75634]:   <features>
Nov 15 19:12:44 user nova-compute[75634]:     <acpi/>
Nov 15 19:12:44 user nova-compute[75634]:     <apic/>
Nov 15 19:12:44 user nova-compute[75634]:     <vmcoreinfo/>
Nov 15 19:12:44 user nova-compute[75634]:   </features>
Nov 15 19:12:44 user nova-compute[75634]:   <clock offset="utc">
Nov 15 19:12:44 user nova-compute[75634]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 19:12:44 user nova-compute[75634]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 19:12:44 user nova-compute[75634]:     <timer name="hpet" present="no"/>
Nov 15 19:12:44 user nova-compute[75634]:   </clock>
Nov 15 19:12:44 user nova-compute[75634]:   <cpu mode="custom" match="exact">
Nov 15 19:12:44 user nova-compute[75634]:     <model>Nehalem</model>
Nov 15 19:12:44 user nova-compute[75634]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 19:12:44 user nova-compute[75634]:   </cpu>
Nov 15 19:12:44 user nova-compute[75634]:   <devices>
Nov 15 19:12:44 user nova-compute[75634]:     <disk type="file" device="disk">
Nov 15 19:12:44 user nova-compute[75634]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 19:12:44 user nova-compute[75634]:       <source file="/opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk"/>
Nov 15 19:12:44 user nova-compute[75634]:       <target dev="vda" bus="virtio"/>
Nov 15 19:12:44 user nova-compute[75634]:     </disk>
Nov 15 19:12:44 user nova-compute[75634]:     <interface type="ethernet">
Nov 15 19:12:44 user nova-compute[75634]:       <mac address="fa:16:3e:53:ae:d5"/>
Nov 15 19:12:44 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:12:44 user nova-compute[75634]:       <mtu size="1442"/>
Nov 15 19:12:44 user nova-compute[75634]:       <target dev="tapc3a70a06-c5"/>
Nov 15 19:12:44 user nova-compute[75634]:     </interface>
Nov 15 19:12:44 user nova-compute[75634]:     <serial type="pty">
Nov 15 19:12:44 user nova-compute[75634]:       <log file="/opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/console.log" append="off"/>
Nov 15 19:12:44 user nova-compute[75634]:     </serial>
Nov 15 19:12:44 user nova-compute[75634]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 19:12:44 user nova-compute[75634]:     <video>
Nov 15 19:12:44 user nova-compute[75634]:       <model type="virtio"/>
Nov 15 19:12:44 user nova-compute[75634]:     </video>
Nov 15 19:12:44 user nova-compute[75634]:     <rng model="virtio">
Nov 15 19:12:44 user nova-compute[75634]:       <backend model="random">/dev/urandom</backend>
Nov 15 19:12:44 user nova-compute[75634]:     </rng>
Nov 15 19:12:44 user nova-compute[75634]:     <controller type="usb" index="0" model="none"/>
Nov 15 19:12:44 user nova-compute[75634]:     <memballoon model="virtio">
Nov 15 19:12:44 user nova-compute[75634]:       <stats period="10"/>
Nov 15 19:12:44 user nova-compute[75634]:     </memballoon>
Nov 15 19:12:44 user nova-compute[75634]:   </devices>
Nov 15 19:12:44 user nova-compute[75634]: </domain>
Nov 15 19:12:44 user nova-compute[75634]:  {{(pid=75634) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063650665',display_name='tempest-SnapshotDataIntegrityTests-server-1063650665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063650665',id=53,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOig/SfsqEQXBmj5SDVCEhcsitDOQzqHHkBvX+xYKgJv1T5mYRrR8NQSFR4WhOsWghdPrUAa5d+WwEr6f5OOMFUM3SiU19onaA3q947VfTwJbe3ja6ERUFky6PwQkX8JOg==',key_name='tempest-keypair-2081629947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a963091d182847ffb3cc6bfeff81ec3b',ramdisk_id='',reservation_id='r-uajgc1ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-275038818',owner_user_name='tempest-SnapshotDataIntegrityTests-275038818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T19:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfc2bd3fb8c24cab9e1cf15529474a84',uuid=ddf39b22-5917-4bdb-b5d4-43d07591e764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converting VIF {"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG os_vif [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5') {{(pid=75634) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46f466ba-d517-5782-b48e-70ad09469df5', '_type': 'linux-noop'}}, row=False) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a70a06-c5, may_exist=True, interface_attrs={}) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a70a06-c5, col_values=(('qos', UUID('bcff7b90-eab7-414a-8f04-3ef2d5aec4df')),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a70a06-c5, col_values=(('external_ids', {'iface-id': 'c3a70a06-c5bf-4977-a91b-74d879f63644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ae:d5', 'vm-uuid': 'ddf39b22-5917-4bdb-b5d4-43d07591e764'}),), if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:44 user nova-compute[75634]: INFO os_vif [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5')
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:12:44 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No VIF found with MAC fa:16:3e:53:ae:d5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-changed-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG nova.compute.manager [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Refreshing instance network info cache due to event network-changed-c3a70a06-c5bf-4977-a91b-74d879f63644. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Refreshing network info cache for port c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated VIF entry in instance network info cache for port c3a70a06-c5bf-4977-a91b-74d879f63644. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG nova.network.neutron [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-3e953846-966c-44e7-8aa9-ace9a2e1b7a3 req-64dcf8a8-8a3c-4b02-8554-b0470fa9bf59 service nova] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:46 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] No waiting events found dispatching network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:12:47 user nova-compute[75634]: WARNING nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received unexpected event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 for instance with vm_state building and task_state spawning.
Nov 15 19:12:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:47 user nova-compute[75634]: DEBUG nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] No waiting events found dispatching network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:12:47 user nova-compute[75634]: WARNING nova.compute.manager [req-86872857-894b-4735-8613-55dcca075b3b req-679ec79e-1916-4df2-9126-102c3b29a2f4 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received unexpected event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 for instance with vm_state building and task_state spawning.
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Instance event wait completed in 0 seconds for  {{(pid=75634) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Guest created on hypervisor {{(pid=75634) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 19:12:48 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Instance spawned successfully.
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_cdrom_bus of ide {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_disk_bus of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_input_bus of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_pointer_model of None {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_video_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Found default for hw_vif_model of virtio {{(pid=75634) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 19:12:48 user nova-compute[75634]: INFO nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 15 19:12:48 user nova-compute[75634]: DEBUG nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Checking state {{(pid=75634) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 19:12:48 user nova-compute[75634]: INFO nova.compute.manager [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Took 6.74 seconds to build instance.
Nov 15 19:12:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-f0453635-7fe7-421b-b461-9e24b672fcf8 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.853s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:49 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:50 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:52 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:12:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:12:54 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:12:54 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.014503479003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 19:12:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 19:12:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:12:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:12:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:12:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 19:12:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 19:12:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:12:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:12:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:11 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:12 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:17 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:22 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:13:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:13:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:51 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:13:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:13:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:13:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.985187530517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:13:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:13:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:13:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Triggering sync for uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:14:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-changed-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:14:32 user nova-compute[75634]: DEBUG nova.compute.manager [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Refreshing instance network info cache due to event network-changed-c3a70a06-c5bf-4977-a91b-74d879f63644. {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 19:14:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:14:32 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:14:32 user nova-compute[75634]: DEBUG nova.network.neutron [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Refreshing network info cache for port c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 19:14:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated VIF entry in instance network info cache for port c3a70a06-c5bf-4977-a91b-74d879f63644. {{(pid=75634) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 19:14:33 user nova-compute[75634]: DEBUG nova.network.neutron [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:14:33 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-459aaf8e-195e-46de-93a6-a1e0246fcbea req-26cccb7f-1bf1-40d3-a032-30cd182f0fe0 service nova] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:35 user nova-compute[75634]: INFO nova.compute.manager [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attaching volume e73aced6-2eef-4a8a-9163-bbde67bee3f0 to /dev/vdb
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.utils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75ad0d-4f02-4b81-ad3c-4eb26a9ebc7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf2485-14c8-4603-857d-c39a37a54b4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[2790d216-5812-48c1-b88f-c68f21818674]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0c4c9-1a6f-44c2-bffa-4600d6d60270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:14:35 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:14:35 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7bf5d-abc1-43aa-bd9d-791eddcdbb8c]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG os_brick.utils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:14:35 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating existing volume attachment record: f7df7db6-1fb2-4ece-bef2-dfcff91fa8c1 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:14:37 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeuxahYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:14:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:14:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:14:40 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabefb5f-b62e-4add-8b06-2b95b7e841c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:14:40 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c0e06-afbb-4a3a-8372-b4b50f42ceb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0] added
Nov 15 19:14:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951c3bb-015b-4923-92e8-c9e266b76dff]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6215861-6836-446d-820b-b832ba778a6d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeuxahYf {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeuxahYf" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[53083f9f-c9c5-41d2-9200-3b13ee50854f]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BeuxahYf'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[07351ce1-c86b-4e60-85cb-2258d352bc4e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ba397-c514-4270-869d-1971460e4d82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:14:40 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:14:40 user nova-compute[75634]:  {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:14:40 user nova-compute[75634]: WARNING os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 19:14:40 user nova-compute[75634]: 
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5778e440-70ac-4cde-bcd9-2d9d25542509]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260]
Nov 15 19:14:40 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260] successful.
Nov 15 19:14:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da1bb2-1c12-491b-bbb7-c2c09ff98c51]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66513f8-07ea-46f0-8a30-9d2ce0c79d24]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)
Nov 15 19:14:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)
Nov 15 19:14:40 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[73500a84-a2d6-4b75-8472-7b4e8d92af26]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:14:40 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeuxahYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26564336533363365', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564336533363365', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:14:41 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:14:41 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:14:41 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:14:41 user nova-compute[75634]:   <serial>e73aced6-2eef-4a8a-9163-bbde67bee3f0</serial>
Nov 15 19:14:41 user nova-compute[75634]: </disk>
Nov 15 19:14:41 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:14:41 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No VIF found with MAC fa:16:3e:53:ae:d5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:14:42 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:42 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8e8ef807-e2f5-4267-9df2-64b304315f7d tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.500s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:14:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:53 user nova-compute[75634]: INFO nova.compute.manager [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Detaching volume e73aced6-2eef-4a8a-9163-bbde67bee3f0
Nov 15 19:14:53 user nova-compute[75634]: INFO nova.virt.block_device [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attempting to driver detach volume e73aced6-2eef-4a8a-9163-bbde67bee3f0 from mountpoint /dev/vdb
Nov 15 19:14:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Attempting to detach device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:14:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:14:53 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:14:53 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:14:53 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:14:53 user nova-compute[75634]:   <serial>e73aced6-2eef-4a8a-9163-bbde67bee3f0</serial>
Nov 15 19:14:53 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:14:53 user nova-compute[75634]: </disk>
Nov 15 19:14:53 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:14:53 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config.
Nov 15 19:14:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:14:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:14:53 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:14:53 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:14:53 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:14:53 user nova-compute[75634]:   <serial>e73aced6-2eef-4a8a-9163-bbde67bee3f0</serial>
Nov 15 19:14:53 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:14:53 user nova-compute[75634]: </disk>
Nov 15 19:14:53 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:14:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:14:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:14:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=24.983963012695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:14:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:14:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:14:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:07 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:13 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 is timed out.
Nov 15 19:15:13 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config.
Nov 15 19:15:13 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeuxahYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:15:13 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f9811f-e17c-4455-8d0c-a3f4599503d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:15:13 user nova-compute[75634]: No targets found.
Nov 15 19:15:13 user nova-compute[75634]: iSNS:
Nov 15 19:15:13 user nova-compute[75634]: No targets found.
Nov 15 19:15:13 user nova-compute[75634]: STATIC:
Nov 15 19:15:13 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0
Nov 15 19:15:13 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:15:13 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:15:13 user nova-compute[75634]: FIRMWARE:
Nov 15 19:15:13 user nova-compute[75634]: No targets found.
Nov 15 19:15:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:15:13 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:15:13 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c537de2-14a1-4748-b2da-ee909f900f2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1c6f6-e27f-4c87-97b5-18eb0daf1cf2]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)
Nov 15 19:15:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 (non-flash)
Nov 15 19:15:13 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b710a64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc4c02b-3326-4c10-9005-df8f1df053db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560dced-d982-4da9-a96a-594004c2334d]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b8211-23cb-4398-841a-ddaa759174f6]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece26a82-1af0-4a7b-868e-4cfd2c872b20]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad8d0f-2da6-4933-aa29-d34161f435a1]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:13 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[698f3ca1-8a5d-4486-ace6-82c6ea92b4b8]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260]
Nov 15 19:15:14 user nova-compute[75634]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0, portal: 172.16.0.220,3260] successful.
Nov 15 19:15:14 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73aced6-2eef-4a8a-9163-bbde67bee3f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[25809578-500d-487d-b05d-7dd8e8915f38]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== disconnect_volume: return (293ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG nova.objects.instance [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:15:14 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-c17a7806-d156-413b-8290-12b810c63438 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.588s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:15:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG nova.objects.instance [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:15:45 user nova-compute[75634]: INFO nova.compute.manager [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attaching volume d5d90479-e42f-4790-b969-0cf98bdc1c07 to /dev/vdb
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.utils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb7e28c-a957-4368-97e4-e2fec4fcfb72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede26c5e-f989-443b-8b8a-afe596b67943]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[02490115-e0af-4c3f-9c24-82019557a9d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa265da6-9df6-4f38-895e-ed0888f8c18c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:15:45 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:15:45 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[94568af7-4ce6-472a-8a17-fa8333421b46]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG os_brick.utils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:15:45 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating existing volume attachment record: 8ad7e2f3-8c8d-4bec-afcc-267089b16f6c {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:15:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqVZygeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:15:50 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:15:50 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:15:50 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f21c73-06bf-40f0-8d9f-ec1194fb9ede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:15:50 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a7efd-d2b5-416a-a68e-6fab0957f0ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07] added
Nov 15 19:15:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad3a7c-eed4-48de-a16d-23f8e777de41]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbdc9c-d471-4764-82e5-f0e96496dff5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqVZygeQ {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqVZygeQ" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e7c48-6d61-4f54-80ab-360dc9da2e3d]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqVZygeQ'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce463a-7c1d-435c-aa79-fd9a928d1807]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e2bb9-7b67-424a-953c-f4290f67e11e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:15:50 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:15:50 user nova-compute[75634]:  {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:15:50 user nova-compute[75634]: WARNING os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 19:15:50 user nova-compute[75634]: 
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8aa65-199c-4cdc-b7c2-d245af710379]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260]
Nov 15 19:15:50 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260] successful.
Nov 15 19:15:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9bc3a9-80ae-42df-b6d0-9f61c76dc8b0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4988970-02d7-4b94-89bb-88b1841133eb]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)
Nov 15 19:15:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)
Nov 15 19:15:50 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3a502-1981-416d-a8ba-dabb0df05d36]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:15:50 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqVZygeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23462303137353761', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462303137353761', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.objects.instance [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:15:51 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:15:51 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:15:51 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:15:51 user nova-compute[75634]:   <serial>d5d90479-e42f-4790-b969-0cf98bdc1c07</serial>
Nov 15 19:15:51 user nova-compute[75634]: </disk>
Nov 15 19:15:51 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:15:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No VIF found with MAC fa:16:3e:53:ae:d5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:15:52 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-96a51319-7c46-4ec1-8a1a-d0aa07f8c038 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.639s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:15:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:15:54 user nova-compute[75634]: INFO nova.compute.manager [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Detaching volume d5d90479-e42f-4790-b969-0cf98bdc1c07
Nov 15 19:15:54 user nova-compute[75634]: INFO nova.virt.block_device [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attempting to driver detach volume d5d90479-e42f-4790-b969-0cf98bdc1c07 from mountpoint /dev/vdb
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Attempting to detach device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:15:54 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:15:54 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:15:54 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:15:54 user nova-compute[75634]:   <serial>d5d90479-e42f-4790-b969-0cf98bdc1c07</serial>
Nov 15 19:15:54 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:15:54 user nova-compute[75634]: </disk>
Nov 15 19:15:54 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:15:54 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config.
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:15:54 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:15:54 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:15:54 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:15:54 user nova-compute[75634]:   <serial>d5d90479-e42f-4790-b969-0cf98bdc1c07</serial>
Nov 15 19:15:54 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:15:54 user nova-compute[75634]: </disk>
Nov 15 19:15:54 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:15:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:15:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:15:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.98303985595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:15:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:15:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:15:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:15:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:15:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:15 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 is timed out.
Nov 15 19:16:15 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config.
Nov 15 19:16:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqVZygeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:16:15 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[79670f88-cfa9-433d-bd9a-62fc5a508310]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:16:15 user nova-compute[75634]: No targets found.
Nov 15 19:16:15 user nova-compute[75634]: iSNS:
Nov 15 19:16:15 user nova-compute[75634]: No targets found.
Nov 15 19:16:15 user nova-compute[75634]: STATIC:
Nov 15 19:16:15 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07
Nov 15 19:16:15 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:16:15 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:16:15 user nova-compute[75634]: FIRMWARE:
Nov 15 19:16:15 user nova-compute[75634]: No targets found.
Nov 15 19:16:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:16:15 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:16:15 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad36a69-1160-4f3a-b351-4989603d67ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fc49d-d93b-4f99-b25a-e892c2145be4]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)
Nov 15 19:16:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 (non-flash)
Nov 15 19:16:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b4452f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b25ab21-84a6-40e1-841a-21865c9bf666]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e767e-7e2c-4f4a-9ff9-b640faa79472]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1b032-39eb-4a80-b2f9-f723850af20a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a5b9a-5e4e-4bd1-968b-acd6c1a4315f]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a141d986-fbee-410a-a143-d8595e790e96]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a89bf2-3d69-457c-9a85-4926bfcc53ed]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260]
Nov 15 19:16:15 user nova-compute[75634]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07, portal: 172.16.0.220,3260] successful.
Nov 15 19:16:15 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d90479-e42f-4790-b969-0cf98bdc1c07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cdaa9c-b206-47bf-9307-668c9342d14b]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== disconnect_volume: return (285ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:16:15 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:16:16 user nova-compute[75634]: DEBUG nova.objects.instance [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:16:16 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-b18124cb-fa7f-4702-84a9-403b8c4f9d3b tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:16:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:16:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:16:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG nova.objects.instance [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:16:46 user nova-compute[75634]: INFO nova.compute.manager [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attaching volume 5f094555-0a69-46e9-92ae-0f58fca1a9d2 to /dev/vdb
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.utils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12fbe05-11a9-4359-8e60-734c7c8eb6fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b36c49a-3fd8-4895-b96c-aba2b6cc69f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c171a-f812-46ea-b9e4-9e4042409a88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd5ea3-38e2-40e1-b422-b45082ff0be7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:16:46 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:16:46 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ac366e-b1ec-4a2b-bfa7-76f737e2b47d]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG os_brick.utils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:16:46 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating existing volume attachment record: d4e9c3b4-2470-4228-a1ca-e11672bdf115 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:16:47 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUgfBbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:16:51 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:16:51 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:16:51 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa10249-ce8f-4d52-9adb-b208f63910f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:16:51 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ac6721-a8a1-4fad-a5fe-dad0dcd47789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2] added
Nov 15 19:16:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c895bae-8044-4900-ba51-f9bbcdf4cc6e]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5ba23-4a51-47d7-b3ce-9d9f14ebcc35]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCUgfBbc {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCUgfBbc" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed64f3-2b23-4bf2-8197-88898d430544]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCUgfBbc'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3460fcda-2bba-4c78-aa0b-62b12d29f1c5]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627c7c6-78d5-4f16-8466-6d638ffc9c6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:16:51 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:16:51 user nova-compute[75634]:  {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:16:51 user nova-compute[75634]: WARNING os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 19:16:51 user nova-compute[75634]: 
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[819acb0f-7771-4b46-8972-eaa54cd08a42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260]
Nov 15 19:16:51 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260] successful.
Nov 15 19:16:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab799da-9e80-4664-9f12-0e73203401ab]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd46c018-91d9-4996-bca4-37ecbce7de16]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)
Nov 15 19:16:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)
Nov 15 19:16:51 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1b285-3489-44c2-a375-e9a1b36589b4]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:16:51 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUgfBbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23661353063306436', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661353063306436', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG nova.objects.instance [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:16:52 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:16:52 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:16:52 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:16:52 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:16:52 user nova-compute[75634]:   <serial>5f094555-0a69-46e9-92ae-0f58fca1a9d2</serial>
Nov 15 19:16:52 user nova-compute[75634]: </disk>
Nov 15 19:16:52 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:16:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:16:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:16:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No VIF found with MAC fa:16:3e:53:ae:d5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:16:53 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-43e6c00a-4348-4c8a-967e-b9299f2ccadd tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.544s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:16:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75634) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 19:16:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:16:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:16:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=24.9820556640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:16:55 user nova-compute[75634]: INFO nova.compute.manager [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Detaching volume 5f094555-0a69-46e9-92ae-0f58fca1a9d2
Nov 15 19:16:55 user nova-compute[75634]: INFO nova.virt.block_device [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attempting to driver detach volume 5f094555-0a69-46e9-92ae-0f58fca1a9d2 from mountpoint /dev/vdb
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Attempting to detach device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:16:55 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:16:55 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:16:55 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:16:55 user nova-compute[75634]:   <serial>5f094555-0a69-46e9-92ae-0f58fca1a9d2</serial>
Nov 15 19:16:55 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:16:55 user nova-compute[75634]: </disk>
Nov 15 19:16:55 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:16:55 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config.
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:16:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:16:55 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:16:55 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:16:55 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:16:55 user nova-compute[75634]:   <serial>5f094555-0a69-46e9-92ae-0f58fca1a9d2</serial>
Nov 15 19:16:55 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:16:55 user nova-compute[75634]: </disk>
Nov 15 19:16:55 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:16:56 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:16:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:56 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:56 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:16:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:16:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:00 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:15 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:16 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 is timed out.
Nov 15 19:17:16 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config.
Nov 15 19:17:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUgfBbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:17:16 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b624bc8-66ef-4a02-b0ad-34f2c1779ae9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:17:16 user nova-compute[75634]: No targets found.
Nov 15 19:17:16 user nova-compute[75634]: iSNS:
Nov 15 19:17:16 user nova-compute[75634]: No targets found.
Nov 15 19:17:16 user nova-compute[75634]: STATIC:
Nov 15 19:17:16 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2
Nov 15 19:17:16 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:17:16 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:17:16 user nova-compute[75634]: FIRMWARE:
Nov 15 19:17:16 user nova-compute[75634]: No targets found.
Nov 15 19:17:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:17:16 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:17:16 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e65d10-1e60-49b1-a4f1-be4d36db8876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c01777-5138-4cb3-ac5d-4bcdc4297c6c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)
Nov 15 19:17:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 (non-flash)
Nov 15 19:17:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b68447130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddecbb2-6738-4eb6-bf4c-9103d30396ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[42616ba1-28a4-44b8-8cf9-97fda7818f99]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbce5e65-b332-4211-aa98-ef0bfc2fb02a]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed169c-d1c9-4443-aa2e-d391be673740]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d6b94-1093-4420-83b9-f1248b535c86]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e1a5e0-8319-47f7-8dfb-dfa5e8bb4fe6]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260]
Nov 15 19:17:16 user nova-compute[75634]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2, portal: 172.16.0.220,3260] successful.
Nov 15 19:17:16 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f094555-0a69-46e9-92ae-0f58fca1a9d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1cfcb-b3c8-4f10-bea0-8e508cea1015]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== disconnect_volume: return (311ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:17:16 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:17:17 user nova-compute[75634]: DEBUG nova.objects.instance [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:17:17 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-624ab285-4dfa-45bd-aad7-fe2678ac7196 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.614s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:17:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:17:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:17:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:17:47 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:17:47 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:17:48 user nova-compute[75634]: INFO nova.compute.manager [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attaching volume a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 to /dev/vdb
Nov 15 19:17:48 user nova-compute[75634]: DEBUG os_brick.utils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6f22a-5f0d-43fe-bae5-0a75a03244db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9fce4fba7d\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:48 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4043a12-7018-4606-8b6c-34369d19f672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[900def58-2b4b-45d1-bd8d-e91cb26176f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[63879dba-15d2-494b-a96a-a66ba9127709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Running cmd (subprocess): nvme version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] nvme not present on system {{(pid=75634) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 19:17:49 user nova-compute[75634]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 19:17:49 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc3c23a-8e56-4685-a296-9ddc75306a98]: (4, '') {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75634) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.lightos [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] LIGHTOS: no hostnqn found. {{(pid=75634) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG os_brick.utils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9fce4fba7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG nova.virt.block_device [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating existing volume attachment record: d6b7e376-07f3-40df-a978-658f03ec7325 {{(pid=75634) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 19:17:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:17:52 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:52 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Calling os-brick to attach iSCSI Volume {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLseOXoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:17:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:17:53 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:17:53 user nova-compute[75634]: INFO os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdbcd1f-2b79-428a-b95e-42520fc09e8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 19:17:53 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25cb0d-04b5-4ec1-a823-c2d8160040cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9] added\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9] added
Nov 15 19:17:53 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e13bd-a9f1-468c-b2c4-6dda99962b6c]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:53 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c31a94e-98cb-45a7-9aa2-4128fcd23055]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLseOXoH {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLseOXoH" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecbdc83-e04c-4b40-b65c-1029e6c62030]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLseOXoH'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bbec41-f185-45b0-b44e-61dbb50460e8]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[89647982-5a54-4ee7-8a77-92b42e4c80e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:17:54 user nova-compute[75634]:  {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 19:17:54 user nova-compute[75634]:  {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:17:54 user nova-compute[75634]: WARNING os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 19:17:54 user nova-compute[75634]: 
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --login {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62907fb-0f99-4edc-ac59-fc123a78daa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260]
Nov 15 19:17:54 user nova-compute[75634]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260] successful.
Nov 15 19:17:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[522fc0e7-4cf9-4b09-9aee-47f3aea230b2]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e440992-f91a-433f-a701-3c5642cb1656]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)
Nov 15 19:17:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)
Nov 15 19:17:54 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to 172.16.0.220:3260 {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75634) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75634) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d634d7e-fda9-4d19-a92e-c1a492bc8176]: (4, ('- - 0', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:17:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:17:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.981121063232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75634) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLseOXoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75634) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '26463393261323463', 'path': '/dev/sdb'} {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463393261323463', 'path': '/dev/sdb'} {{(pid=75634) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 19:17:55 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:17:55 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:17:55 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:17:55 user nova-compute[75634]:   <serial>a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9</serial>
Nov 15 19:17:55 user nova-compute[75634]: </disk>
Nov 15 19:17:55 user nova-compute[75634]:  {{(pid=75634) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing inventories for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating ProviderTree inventory for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Updating inventory in ProviderTree for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing aggregate associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, aggregates: None {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Refreshing trait associations for resource provider 505e734b-a7a7-4ad8-9307-19cae75d31aa, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75634) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75634) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] No VIF found with MAC fa:16:3e:53:ae:d5, not building metadata {{(pid=75634) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 19:17:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8cff6d47-737f-47cc-b3e8-3816e40a2916 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.930s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:17:57 user nova-compute[75634]: INFO nova.compute.manager [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Detaching volume a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9
Nov 15 19:17:57 user nova-compute[75634]: INFO nova.virt.block_device [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Attempting to driver detach volume a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 from mountpoint /dev/vdb
Nov 15 19:17:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Attempting to detach device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config. {{(pid=75634) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 19:17:57 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:17:57 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:17:57 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:17:57 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:17:57 user nova-compute[75634]:   <serial>a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9</serial>
Nov 15 19:17:57 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:17:57 user nova-compute[75634]: </disk>
Nov 15 19:17:57 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:17:58 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the persistent domain config.
Nov 15 19:17:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config. {{(pid=75634) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 19:17:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.guest [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 19:17:58 user nova-compute[75634]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 19:17:58 user nova-compute[75634]:   <source dev="/dev/sdb"/>
Nov 15 19:17:58 user nova-compute[75634]:   <target dev="vdb" bus="virtio"/>
Nov 15 19:17:58 user nova-compute[75634]:   <serial>a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9</serial>
Nov 15 19:17:58 user nova-compute[75634]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 19:17:58 user nova-compute[75634]: </disk>
Nov 15 19:17:58 user nova-compute[75634]:  {{(pid=75634) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 19:17:58 user nova-compute[75634]: DEBUG nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:18:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:18:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:02 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:02 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:05 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:10 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:18:10 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 19:18:10 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] There are 0 instances to clean {{(pid=75634) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 19:18:11 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:11 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75634) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:18:15 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:18 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 is timed out.
Nov 15 19:18:18 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully detached device vdb from instance ddf39b22-5917-4bdb-b5d4-43d07591e764 from the live domain config.
Nov 15 19:18:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] calling os-brick to detach iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5b68120190>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLseOXoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 19:18:18 user nova-compute[75634]: WARNING os_brick.initiator.connectors.base [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[c618ef31-3db3-40fe-8842-b6cd25fdee5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 19:18:18 user nova-compute[75634]: No targets found.
Nov 15 19:18:18 user nova-compute[75634]: iSNS:
Nov 15 19:18:18 user nova-compute[75634]: No targets found.
Nov 15 19:18:18 user nova-compute[75634]: STATIC:
Nov 15 19:18:18 user nova-compute[75634]: Target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9
Nov 15 19:18:18 user nova-compute[75634]:         Portal: 172.16.0.220:3260,-1
Nov 15 19:18:18 user nova-compute[75634]:                 Iface Name: default
Nov 15 19:18:18 user nova-compute[75634]: FIRMWARE:
Nov 15 19:18:18 user nova-compute[75634]: No targets found.
Nov 15 19:18:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 19:18:18 user nova-compute[75634]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 19:18:18 user nova-compute[75634]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75634) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9', 0)] {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2459ba-5f59-4e43-b44a-496d2af0a0e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[631dee90-1888-464e-bbfd-aa127ea90082]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)
Nov 15 19:18:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 (non-flash)
Nov 15 19:18:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5b44312950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9'): ({'sdb'}, set())}) {{(pid=75634) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Removing single pathed devices sdb {{(pid=75634) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d17b5e-b9f9-46db-9468-bdb34ec1ecc2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b275d-7f18-4a4a-9178-ca304180471e]: (4, ('ok\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Flushing IO for device /dev/sdb {{(pid=75634) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2e399-5cfd-42a0-bfaf-e3fc649db487]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75634) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca9a91-ad02-4cd8-ac57-968583f4cbcb]: (4, ('1', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.linuxscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] SCSI volumes sdb have been removed. {{(pid=75634) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9')] {{(pid=75634) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2af038-4eb9-40cf-81a5-5445e40165d0]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --logout {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c93309-a53a-4634-a3c1-6c69ffbafe3f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260]
Nov 15 19:18:18 user nova-compute[75634]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9, portal: 172.16.0.220,3260] successful.
Nov 15 19:18:18 user nova-compute[75634]:  stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op delete {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ac88e0-b1e2-4c3d-8b50-c1b6762b3aa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dfdcd3-aaa3-4dce-a820-7b535d8b6059]: (4, ('', '')) {{(pid=85900) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75634) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.base [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] <== disconnect_volume: return (330ms) None {{(pid=75634) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 19:18:18 user nova-compute[75634]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Disconnected iSCSI Volume {{(pid=75634) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 19:18:19 user nova-compute[75634]: DEBUG nova.objects.instance [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'flavor' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:18:19 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-8a740991-4ffa-4eae-9dbd-06a140712db1 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:18:20 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:18:25 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:18:30 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:35 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:40 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:45 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:50 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:18:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 19:18:54 user nova-compute[75634]: DEBUG oslo_concurrency.processutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 19:18:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:18:55 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=24.980262756347656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Instance ddf39b22-5917-4bdb-b5d4-43d07591e764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75634) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:18:55 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:18:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:57 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:18:57 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquired lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Forcefully refreshing network info cache for instance {{(pid=75634) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.objects.instance [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lazy-loading 'info_cache' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.network.neutron [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [{"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Releasing lock "refresh_cache-ddf39b22-5917-4bdb-b5d4-43d07591e764" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 19:19:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updated the network info_cache for instance {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 19:19:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:01 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:03 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:03 user nova-compute[75634]: INFO nova.compute.manager [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Terminating instance
Nov 15 19:19:03 user nova-compute[75634]: DEBUG nova.compute.manager [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Start destroying the instance on the hypervisor. {{(pid=75634) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-unplugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] No waiting events found dispatching network-vif-unplugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.compute.manager [req-0f5cd9bf-97d9-4aac-acb3-d49411298ae4 req-f6092fdb-3009-48b5-a620-40cccbfb8564 service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-unplugged-c3a70a06-c5bf-4977-a91b-74d879f63644 for instance with task_state deleting. {{(pid=75634) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Instance destroyed successfully.
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.objects.instance [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lazy-loading 'resources' on Instance uuid ddf39b22-5917-4bdb-b5d4-43d07591e764 {{(pid=75634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.virt.libvirt.vif [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T19:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063650665',display_name='tempest-SnapshotDataIntegrityTests-server-1063650665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063650665',id=53,image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOig/SfsqEQXBmj5SDVCEhcsitDOQzqHHkBvX+xYKgJv1T5mYRrR8NQSFR4WhOsWghdPrUAa5d+WwEr6f5OOMFUM3SiU19onaA3q947VfTwJbe3ja6ERUFky6PwQkX8JOg==',key_name='tempest-keypair-2081629947',keypairs=<?>,launch_index=0,launched_at=2023-11-15T19:12:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a963091d182847ffb3cc6bfeff81ec3b',ramdisk_id='',reservation_id='r-uajgc1ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c2255c9-a9c5-4496-8a92-18849f2ce081',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-275038818',owner_user_name='tempest-SnapshotDataIntegrityTests-275038818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T19:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfc2bd3fb8c24cab9e1cf15529474a84',uuid=ddf39b22-5917-4bdb-b5d4-43d07591e764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converting VIF {"id": "c3a70a06-c5bf-4977-a91b-74d879f63644", "address": "fa:16:3e:53:ae:d5", "network": {"id": "02b977ba-1521-4509-8ee1-96918755f8f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-710936111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a963091d182847ffb3cc6bfeff81ec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a70a06-c5", "ovs_interfaceid": "c3a70a06-c5bf-4977-a91b-74d879f63644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.network.os_vif_util [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5') {{(pid=75634) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG os_vif [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5') {{(pid=75634) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a70a06-c5, bridge=br-int, if_exists=True) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcff7b90-eab7-414a-8f04-3ef2d5aec4df) {{(pid=75634) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:04 user nova-compute[75634]: INFO os_vif [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ae:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3a70a06-c5bf-4977-a91b-74d879f63644,network=Network(02b977ba-1521-4509-8ee1-96918755f8f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a70a06-c5')
Nov 15 19:19:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Deleting instance files /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764_del
Nov 15 19:19:04 user nova-compute[75634]: INFO nova.virt.libvirt.driver [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Deletion of /opt/stack/data/nova/instances/ddf39b22-5917-4bdb-b5d4-43d07591e764_del complete
Nov 15 19:19:04 user nova-compute[75634]: INFO nova.compute.manager [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 19:19:04 user nova-compute[75634]: DEBUG oslo.service.loopingcall [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75634) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.compute.manager [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Deallocating network for instance {{(pid=75634) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 19:19:04 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] deallocate_for_instance() {{(pid=75634) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 19:19:05 user nova-compute[75634]: DEBUG nova.network.neutron [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Updating instance_info_cache with network_info: [] {{(pid=75634) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 19:19:05 user nova-compute[75634]: INFO nova.compute.manager [-] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Took 0.73 seconds to deallocate network for instance.
Nov 15 19:19:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:05 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:19:05 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:19:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:05 user nova-compute[75634]: INFO nova.scheduler.client.report [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Deleted allocations for instance ddf39b22-5917-4bdb-b5d4-43d07591e764
Nov 15 19:19:05 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-86138523-69be-482a-a9d8-d954f0216835 tempest-SnapshotDataIntegrityTests-275038818 tempest-SnapshotDataIntegrityTests-275038818-project-member] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:19:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] Acquiring lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:06 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] Lock "ddf39b22-5917-4bdb-b5d4-43d07591e764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] No waiting events found dispatching network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 19:19:06 user nova-compute[75634]: WARNING nova.compute.manager [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received unexpected event network-vif-plugged-c3a70a06-c5bf-4977-a91b-74d879f63644 for instance with vm_state deleted and task_state None.
Nov 15 19:19:06 user nova-compute[75634]: DEBUG nova.compute.manager [req-f4cd2f42-9e42-4650-9ace-59a44fc069ac req-bf21ef42-98c0-44bd-8a9e-661c11ed232c service nova] [instance: ddf39b22-5917-4bdb-b5d4-43d07591e764] Received event network-vif-deleted-c3a70a06-c5bf-4977-a91b-74d879f63644 {{(pid=75634) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 19:19:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:16 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:24 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:29 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:34 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:39 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:44 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75634) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75634) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 19:19:49 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 19:19:53 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Auditing locally available compute resources for user (node: user) {{(pid=75634) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:54 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:19:54 user nova-compute[75634]: WARNING nova.virt.libvirt.driver [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=25.00757598876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75634) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75634) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.provider_tree [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed in ProviderTree for provider: 505e734b-a7a7-4ad8-9307-19cae75d31aa {{(pid=75634) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.scheduler.client.report [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Inventory has not changed for provider 505e734b-a7a7-4ad8-9307-19cae75d31aa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75634) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG nova.compute.resource_tracker [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Compute_service record updated for user:user {{(pid=75634) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 19:19:54 user nova-compute[75634]: DEBUG oslo_concurrency.lockutils [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75634) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 19:19:57 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:19:58 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:59 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:19:59 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75634) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 19:19:59 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:20:00 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:20:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Starting heal instance info cache {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 19:20:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Rebuilding the list of instances to heal {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 19:20:00 user nova-compute[75634]: DEBUG nova.compute.manager [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Didn't find any instances for network info cache update. {{(pid=75634) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 19:20:01 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:20:02 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:20:03 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:20:03 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:20:04 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:20:05 user nova-compute[75634]: DEBUG oslo_service.periodic_task [None req-5f460a87-6250-4e5a-a7e3-9c414140df73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 19:20:09 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:20:14 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 19:20:19 user nova-compute[75634]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75634) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}